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ABSTRACT . ^ 

The rapid increasfj in the number and variety of 
naster's degriee programs offered across the United Stares has 
generated a great deal of concern within the academy regarding the 
quality of the^e programs. This conference* was designed to explore 
the numerous issues of quality and assessment at the master's level 
from a variety of perspectives. This volume of IB contributed papers 
focuses on the areas of needs and objectives, curriculum design and 
delivery, the meaning of quality, extant standards of quality for 
accreditation, definitions of assessment and methods of assessment 
for master's prog;rams. Methods of assessment are specific to two 
types of master's degree program: type 1 centers in advanced studies 
in an academic discipline, e.g., history, physics, and sociology; 
and, type 2 is professionally or vocationally oriented as in 
engineering, law, applied music, teaching or in a discipline in 
preparation for teaching. (RL) 
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INTRODUCTION 



Tha rapid Increase In the number and variety of master's degree programs 
offered across the United States has generated a great deal of concern within 
the academy regarding the quality of these programs. This conference has been 
designed to explore the numerous Issues of quality and assessment at the master's 
level from a variety of perspectives. Though all the Issues will rvot bo resolved 
or even be discussed, It Is our belief that such a forum will be productive and 
will generate thoughtful and deliberative approaches to the definition and 
assessment of quality at the master's level. The program schedule has been 
developed to consider needs and objectives, curriculum design and delivery, 
the meaning of quality, extant standards of quality for accreditation, 
definitions of assessment and methods of assessment for master's programs. 

I would like to take this opportunity to thank Dr. Robert Klrkwood of the 
Middle States Association of Colleges and Schools and Dr. Michael J. Pelczar, Jr., 
of the Council of Graduate Schools In the United States* for their guidance and 
aid In the development of the program. I would also llkd to thank Ma. Nancy 
Hedberg for her Invaluable administrative assistance on all aspects of the 
conference. 

This volume contains contributed papers for the conference. An additional 
volume of Conference Proceedings will be mailed to all participants. 

I would like to wish each of you an enjoyable three days in our attempt 
to understand and delineate the problems associated with the assessment of 
quality In master's programs. 



Milton A. Grodsky \J 
Dean and Conference Chairperson 
University of Maryland 
University College 
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POTSDAM' COl, I, K(^H 

'Plil'! VALUii: AND MI'lANiNO i)V PAKT-TIMM MAST i:!-' ' .S 1 ' : l^y\Mr. ^■ 

St:at:o IJn i V(jrs i. Ly of: N(?w Yoi'k, CoIIimic at I'ol sd.nii 

A LompesL has aiisen boLwoc»n l:hoso (iradua'Lo oi-fioorhi and fticulty 
who feel that a part-time Mast(-L'»s procjram \ i\ almost c(?rtainly of l(-'.;'(}r 
quality than a full-ltiine program and those who are endorsing part-time 
programs to suit societal and community needs. The Council on Graduate 
Schools set the tone for a long while by stating in its influential 
treatment of the Master's degree that: 

Continued part-time study over a period of several years with 
no full-time attendance is discouraged.-^ 

On the other hand, the Panel on Alternate Approaches to Graduate Educa- 
tion exults that a diversity has set in in Master's programs. The 
Panel's report describes the clientele for the Master ^s degree in a 
hymn to pluralism: 

The graduate student may be ^ police sergeant studying two 
nights a week in a criminology ^seminar , a housewife-part-time 
high school English teacher commuting by ca.r once a week from 
her suburb to an urban university; a young raan ./hose uninter- 
rupted cycle of study commenced at public high school and led 
from a junior college to a state university; persons whose 
hope for a salary increment depends on the completion of 
another pair of credit hours; people whose lives are so 
variously harried — by .anxiety about orals or ungradedV blue- 
books, or classes still to prepare — that thev cannot them-^ 
selves arrive at a coherent statement of their motivation. 



*This paper was prepared for presentation to and delivered before the 
Conference on The Assessment of Quality of Master's Programs held from 
March 1 to March 3, 1979, .at the University of Maryland, College Park, 
Maryland, under the joint sponsorship of the Commission on Higher 
Education of the Middle (states Association of Colleges and Schools, The 
Council of Graduate Schools in the United States, c^nd the University 
of Maryland University College. 

1. Council of Graduate Schools - the United States, The Master Degree 
(Washington, D.C., 1971), 9; Stephen H. Spurr in his Academic Degree 
Standards: Innovative Approaches, (Carnegie Foundation, 1970), 73- 
75, is. silent on the issue of part-time stu'y. ^ 

2. Panel on Alternate Approaches to Graduate .Education, Scholarship for 
. Society , (Princeton, N. J. , 1973)-, 14-15. 
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Tlu.' i-i?iK^rl. (H.uiiir. ijnMl »iiumI i!onu!)i iHm t lu? rccciil dt -v* • I m] )nwMil ?; in; 

I. lull: I hLi ij! iulun l.i) si:hoo V t.Mnl)iMci(Mi a vniMoLy ol ini;liln- 

Lions and dopier L inon l.a i)iMMH)nni a varitMiy o\' roli\M, Wo 
boliovo tluU: Lho divorniLy of LnB L i t: uL i onn in, pol imiL Li 1 1 y , 
l:ho (jruatcst sonrco oC sLruncjLh the syrdaMU por.iaM'auu; • - 

William V. Mayvillo, in an ov(.M\handt;d .suLVoy oL \A\o Mlalo oi 
Master's docjrcr' procjrams', ruijards Lhe criticiHin of [)art-LiinG procjrains 
as "commonplace among those witliin cjrciduate schools." Ho quu.s tioris 
whether this is a fair criticism as it seems to be "subject to the 
prejudice of academicians who only wish to teach Ph. D. -motivated stu- 
dents." The fundamental issue has become whether external pressures 
brought to bear on individuals to gain graduate credits or degrees 
should be a clarion call to colleges to create . loosely-structured part- 
time degree programs to make it easy for them. Even a spokesman for 
the Panel on Alternate Approaches to Graduate Education seems to sound 
a note of caution in a brief report in Change magazine: 

It would be a mistake to cast the cause of change in graduate 
education wholly in a mold of do-goodism. Evaluating projects 
as contributions to the health of democracy can lead to atrophy 
of the imagination; the much abused slogans — learning for 
learning's sake, art for art's sake— contain an edge of truth, 
namely that the desire to. do good is far from the most powerful 
spring to creativity.^ 

He goes on, however, to say in balance: 

But we do not believe that creativity will be harmed if graduate 
schools, in a manner appropriate to their distinctive character, 
and function, become more conscious of their potential contri 
bution in fostering "conjoint communicated experience" and aim 



3. Ibid. , 15 

4 William V. Mayville, A Matter of Degree : The Setting for Contem- 
porary Master's Programs. AAHE/ERIC Research Reports (VJashmgton, 
D.C. , 1973) ,9. 

5. Benjamin DeMott, "Reforming Graduate Education," Change , February, 
1974, 29. 
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POTSOAM •! (II.I.I'CF 



im.ro .lii.M-lly al I ,uiii 1 i .i i' i / i U'l I Iumum.- 1 v.-m wilh 111" .lilliM-- 

li.'lwiMsn ,!(•.'. 'pi I'll wi.'i.liiin .iii>l e'm ii'Ml .«ll •.mhiimi;; hcli.'hi. 

M'ho ■iii.|'|o;il ion m.ido Ih.To i:; nol lo cxiliikI ovoiy oo 1 1 . '-lo ' n .| r.i.lii.i I o 

prcxir.iiiui ail api,>a r. mi I. n.uuls aii:!u, l>ii|-. ralhor lo ,ulai>l. piu^iiam ;;cho,lul- 



i luj : 



Coui ;io ;io(nu>noi>.s , roi; i (loiu'O i tMju 1 .i I. i oiis , and ol hor i rnd il.u- , 
lilonal roqui rciiitMil !•. sliouLd bu adapbod Lo moot I lu> iiood;; ol 
sLuKkMits wiLli family ruHpoiui i b i 1. i. L lor:i , adult loatnorfi, pro-, 
foaslonal.s, those forced to pursue their studios intermi.t- 
tently, and others whose admission to graduate education and 
preferred patterns of study differ ^rom those recjarded as 
standard.^ 

Quality for the Panel then remains unaffected if only the style and 
hours of delivery change. But do other critics concerned for excellence 
find the adjustments acceptable? The shift in the balance of the 
graduate student population from the full-time to the part-time category* 
seems for the moment to have pre-empted set limits on the argument but 
the concern over maintaining high standards properly continues in 
Graduate Studies and Academic Affairs offices. 

What can an institution with part-time Master's programs, or the 
y desire to have them, do to anticipate and satisfy justified concerns 
over quality? Let me offer my personal list: 

1) The "college should make sure that present and intended 
part-time urograms, just as its full-time programs, fit 
well into the institutional statement of mission and 



6. Ibid. 28. 

7. Ibid., 28. 
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'Part-time students were 81% of the graduate students enrolled at insti- 
tutions where the Master's degree is the highest degree offered and 
53% of the graduate students at universities where the Ph.D. is tne 

hiqhest degree. , 
• Survey by C . ,G . S. r epo rt ed in A . A . S . C . U . Memp_ to^res i.dent s,. 

'9 ■ ' 



Dr. thi-T^mia .1, Ik'^jarr.y 
POTSDAM (UH.hKCK 

1)1 1 M . In Mu' I wwi I , li K » iii.ui V i I i I II I i I »iui |h t • 1 I • 

Inmlinij (miuI prnlil mm m ,H i im i ) p.u I i'wwr | »i ( ) i .i iu;5 w i ( h 
S(»i)arMtoly hiitnl adjiimM: liUMilly .umI ilnbioiui i'omium'I ion 
wil l^ I. ho r^KMl: t^r l lu^ i nst. i Int i(:>n l.o InOp halnncM^ I hu 
bu(l(jta: . Tho i lU; I i lul. i ona 1 ( umiuu i I uum-i (:. inns t. t ronq ; 

(lU) iiu>vo li) jw^ 1 1. - l\n)d i.nij iiiwl [ut ir.t^iun) ol moiuo .idiinicMji 
shonUl not, liDWtJVor , bo v i i^wchI nf; nn au loniii L i c bar' i.o 
qna I i. ty . 

2) The collocje should rnako sure that the soquonce of conrsos 
noedod lo support the part-time program are appropriate 
to the start/stop, connect/disconnect pattern of part- 
time student enrollments. It is possible that exponses 
of offering many fresh starts and necessary follow-up 
courses will increase rather than decrease costs unless 

'student numbers rise substantially. Once students are 
admitted to a part-time program, the institution should 
honor the obligation to provide necessary course work 
at hours at which they can attend, despite the added 
expense . 

3) The college that is offering part-time programs will 
surely have to alter its hour^ .:ourse offerings to 
fit the working schedule of its new as well as its 
tradi tional students . 

4) Ti olle^je should consider the location of courses. 
Its decision to go off-campus, for example, rather than 
bringing students to the campus creates both opportuni- 
ties for new clienteles and new problems of serving 
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rilmh'Ut Ih'tMlii, IImW, hu t ' >-M lllp I ti , <ln 1 tin new :ilM»liM)|Ji 

in nnltT I iMV{nvti {^IiItm: and nxptM i imk.h* i i »'h "in^w** 
jilihltMU.M (.md ahio ipilM* I lankly, lo k'M^p I Ihmu .ivvMkii 
.illtM' l\.ivin<| workiul nil tkiy) . 'riuinqh Ihor^^ \r^ li It 
rrst>nit?h on IIumi' r I It i V( mu?:i:i , \:h(' t?(n h.MjtJ :ih<uil<l oM^r 
MoiiK? |u~o(ji. niiiiiu 'i J h M rn i luj l:».M.?lm i (|Ut»s (Uui v ul( »(> t n[)» < ?( )\u lu^s 
duL^pilo Lho probcibiliLy of frjtnilty rosistiUico Lo lh(»m. 
The i;oi3ult:s in such courses should be compared with t:lK)He 
in traditional courses and published to help other 
institutions plan and amend procjrams. How can higher 
edicciti.on progress without research and experimentation? 
Do we really know how part-time and/or adult learners 
are best taijght? 
6) The college may have to make the costly decision to keep 
its student services and administrative offices open 
during evening hours and even on weekends. Part-time 
students need easy and regular access to the admissions 
office (or whatever other office is assigned the task of 
admitting), the registrar's office, the advising and 
counseling offices, the career planning office, and per- - 
haps other units as well. They need to have ready access 
to the laboratories, the library, computer terminals and 
otli^r academic support services. Since part-time students 
generally require more, not less, advice than full-time 
students, faculty should be prepared to remain longer 
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I ill, , I 1m. . -VMMi ) Mil i U » il iiiM I . i j u iU* i ilti I I . 't^ ll. »in M .nnl 

/) (\)M.Mj(} |»i .).MMliit eri may \\A\fi^ I.I «'li.iiM|<^ i«» iM.iv'i.lii l»n 

r 

limn lt!.ui\in»|. i^sM iil«MU*y t n (MikmiI :i , il Um'V ^ilMI 

will have lo ol .tl liMMl icinI'M 

pre I (k1 . 

fl) Most: basic l:o iiu.iliLy part.-liiiio MiiMtcr's p!(un,\m:i is 
the (l(^l:iM'ini nal..i on l lhU l .irnlLy who t isich t hi» (^)\ii :;<'S 
will b(3 l:hG Bamo as (or .U: luast tniiial \i\ slalano 
Gxperionce to)^ thoso who t:oach in l;ho fuU-l inu* pro<]!.un, 
that the level of cour^uis be the i.;ame and that t)a rt - 1 i nu^ 
cjraduato students will bo adini ttod as crarcfully -in t hi> i r 
full-timo colleayuos. 

9) Quality in graduate programs, as in programs at other 

levels, demands the integration of the material studied. 
I strongly favor a comprehensive examination, integra- 
tive project or paper or other means of determining that 
the student *has put together in his mind the facts and 
approaches gathered from many courses. A Master's degree 
'ought not to be a mere collection of courses taken and 
credits accumulafed . I am less certain, hewever , as to 
whether a research experience culminating in a thesis 
should be required in every Master's program or whether 
a practicum, internship or other practical application 
of theory should be mandatory. The purpose of a program, 

12 
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not its part-time, delivery, shoult^ in my opinion, 
dcte^rmine whether all or any of the experiences are 
appropriate. The decision is the institution's to 
make. 

If the nine concerns discussed above are squarely faced, whatever 
the local judgment about them, the results ought to be part-time Master's 
programs which not only offer social utility but have academic value. 
Establishing programs which can be defended before quality-minded critics 
>ast be our goal. 
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The Oejilgn of Haster*s Prograiw In Baccalaureate Level Profeasiona 

Joan C. fingera, Ph.D. 
University of florth Carolina, Chapel HIU 

At the last conference of the Council of Graduate Schools in the^United 
Stales, Piednont 119781 pooed a aeries of intriguing questions in his Intro- 
duction to the sessions entitled Probing the Haster's Degree, U the conclu- 
sion of the session, questions such as the Tallowing remained essentially un- 
answered: Uiat ia the level of competence or cchieveinent that should be re^ 
quired? Shoulc candidates be admitted to master's degree prograois if they 
have not earned a bachelor's degree in the saioe field? What should be the 
standards for naater's degrees in fields v/here there is no doctorate? Hie 
prlDiary purpose of the ensuing discussion ia to consider the structure of the 
maaler's degree in baccalaureate level profesalons and Its Impact on the 
Integi'lty of the Baater's degree. This will provide an opportunity to explore 
soine aspecla of the above questions. 

Problem Definition . A precisely defined problem serves as a pre- 
requisite for solution giving. Problem description in this case depends on 
an understanding of the structure of the academic degree and of the prO' 
feaaional curriculum, These franes of reference will be used to support the 
thesis that sowe baccalaureate level prpfeaslons are perpetrating a degree 
structure that is Incongruent with that of higher education, and that this 
disparity ia having the net effect of devaluing the master's degree in that 
field.^ 

The Bcadenic certification process is forinallzed in the awarding of 
academic degrees. Degree titles provide generic labels which suwiarize 
acadeiaic programs. According to Spurr I W3I, two general principles are used 
to nane academic degrees. The first principle Is the level of acadetnic 
achievement and Is represented by the substantive hierarchy of associate's, 
bachelor's, 'ibaster's, and doctor's degrees. The second principle used in 



academic degree nomenclature Is the nature of the course of study. This is 
represented by the qualitative distinctions made between programs emphasizing 
scholarship and thuse einphaoizing professional skills. At the master's level, 
the academic degree terminates in either a Master of Arts (M.A.) or Kaster of 

Science (H.S.), while the professional degree terminates in a Ha^er of 

"(professional field!" or a tester of Science in "(profeasional field)^ 
l^iis, the American degree structure provides. for distinctions between levels 
based only on academic accomplishments and distinctions within levels based 
only on the nature end type of study undertaken. 

The professions superii()08e a professional educational structure on the 
academic degree structure, nainely, the sequence of basic and advanced pro- 
feaslonal education. Basic professional education designates that required 
for entry-level practice. The professional curriculum should be thought of as 
encompassing the basic arts and sciences, in addition to, the professional 
scienc^^s and their application. He ninimun bler»(i of these components deemed 
essential for entry-level prattice la determined by the general consensus of 
the profeaaion and is formalized In prograoiwtlc accreditation standards. 
Advanced professional educatiori may be loosely defined as that beyond the 

Ita chief characteristics are that it la optional in regard to prac* 
tlce and that there ia W^flHy iMs consensus regarding ita content. With- 
in the professional context, therefore, educational distinctions are made In 
reference to educational requirements deemed eaaential as opposed to 
desirable for practice. 

By definition a baccalaureate level profeaaion maintains that its body 
of knowledge and skills and its values and noms may be adequately compre- 
hended and applied with bachelor's level scholarship. Thus, It establlahea a 
congruence between undergraduate and basic professional education Iminlmallyl 
and between graduate and advanced profeasional education. This Is represented 



by the juttirn lib«hd 'Advanced Mister's' In Figure I. This pattern Is 



jjttern Bachelor's Levej tester's Uvel 

•idnnced Uberil Arts i Basic Advanced Professional 
. thaler's' ' Professional Education Education and Graduate 
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followed by an IndiiUwl *o conpleted an undergraduate and graduate 
graduate prograa In the saae profession. 

Hiny baccalaureate level profeaslona have found It advantageous to re- 
cruit college graduates. In order to attract these applicants and to provide 
a course of study designed to aeel their needs, aollltles, and experiences, 
b„lc professional education has also been Instituted at the .aster's level. 
In this case, basic professional education Is no longer Identified «lth under- 
graduate education and advanced professional education Is no longer .ynony«ous 
«ith graduate education. This is depicted by the 'Basic Haster's' pattern In 
Figure 1. Ibis route Is followed by an individual ^ has an undergraduate 
background in the liberal arte, followed by a laater's progran in e profession- 
al field. According to his diagraa, it li clear that graduates of the 
•Advanced' and 'Basic Haster'a' patterns fall to achieve the aaw level of 
prafusional schleveBent, since the advanced profeaslonal co^ionent is lacking 
In the 'Basic tester's' prograi, yet the saie degree is awarded. 



■nils application of different educational achievement criteria creates 
I double-tiered structure wltWn the naater's level, which is NOT provided for 
in the American degree structure. Although I have not undertaken a thorough 
study of the incidence of this 'abnornal degree structure' within the pro- 
fessions; it is evident in architecture, engineering, nursing, occupational 
therapy, and physical therapy. 

At this point, we My profitably pose the question! In what sense can 
the 'Baalc Itester'e' pattern be considered advanced educatioi),? Bent (1^59>' - 
guggested that in a mastar's curriculum conposed primarily of beginning level 
courses, the only 'advanced' characterlatlc Is the age of the student. In » 
algllar attitude, Kaduahin (1965) spplled a temporal criterion, that la to say 
that it la advanced slufly because it follows four years of undergraduate work 
Despite these disparaging perceptions, the situation is usually not that gri« 
In actuality. The graduate requirements, coimon to both degree patterna are 
designed to provide an advanced component. Ihls may Involve a thesis or 
special project for the expreealon of creativity and scholarship, a compretieri- 
live examination to teat overall knowledge, and/or addltlonal couraeHork, 
usually In adminiatration or research. However, the fact remains that there 
la no concerted effort to include advanced profesalonal education objecllvea 
comparable to thoae demanded of students seeking a second profeseional 
degree at the maater's level in that field. 

Solution-giving . The problem presented for resolution is; Is there a 
way In which flexibility in educational entry points into a pr^feesion can bi 
maintained while at the aane time assuring the integrity of the master's 
degree ? Hie most apparent solution is to create a new structure and a. new 
label for the 'Baalc teater'a' degree, This would be similar to the Certifl- 
cate of Advanced Graduate Study awarded for achievement beyond the master'a 
level that falls short of the doctorate. !ipurr(1973l recoimends the certifl- 
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leads ua to reduce the problem to one of seoantlca and public education. 

Tile dual -entry model provided by bualnesa adolnlatratlon provides a / 

\ 

third nechanlsm for accomodating diverse academic backgrounds upon adnlsslon 
and quality upon exit. According to the standards provided by the Accredita- 
tion CouncU of the American Asseobly of Collegiate Schools of Business (1978): 

Haate^'s degree prograoa In business administration nuat require 
students to have coapleted either at the undergraduate or graduate 
level I the equivalent of the conaon body of knowledge In business 
administration!.. For the HBA degree, It is expected that the program ^ 
beyond that In the coaaon body of knowlo<lge ehaU be broad In nature 
and aimed at general competence for overall management. For the other 
master's degrees, the limitation on apeciallutlon will not apply (p. 38). 

Basic professional educational requirements are viewed essentially as pre- 
roqulsltes for advanced professional requlrenents, and both basic and advanced 
professional requirements oust be completed for the master's degree. Xn some 
program formats the advanced professional ccioponent is taken after the basic, 
Mhile in others the basic and advanced components are integrated. Students 
with an undergraduate prepare tion in business may have sonp courses walvcred 
to avoid redundancy. Electives are then substituted for these required courses^ 
Such electives may be used to remedy deficiencies existing in general education 
because of the professional couraes taken at the undergraduate level. In thia 
way, students with professional and non-professional undergraduate majors are 
put on a relatively equal footins. 

Although all three proposals would remediate the*struptural degree ab- 
normality ' at the master's level, the last appears to be most in concert with 

the goals of an educational institution to educate scholarly practitioners 
capable of responding to increasingly complex societal problems. The standarda 
set by the Engineers' Council fbr Professional Development (1976) and by the 
National Association of Schools of Public Affairs and Adrainistration (197AI, as 
well as, the descriptions of the nursing programs at Yale (Dicrs, 1976) and 
Stanford (Smith, 1972)| and the occupational Ujwapy curriculum at the 



University of Southern Callfornli (Relllri 19691 attest to the laodere 
nultldlflclpUnary feasibility ind appeal. 

Quality Indicator: , In order to gain further Insight Into the needs of 
uster^s prograns In baccalaureate professions^ the 'structural degree abnor- 
mality' and the preferred solution to seek cooiparable educational outcomes for 
'Basic and Advanced Kaster*a' graduates will be viewed in relation to quality 
IndlcatorS'-speclflcally^ atudentSf currlculuo, and faculty, It has previously 
been sentloned that the linpstus for Intlatlng the 'Basic Haster's' track was to 
attract high (•otential applicants to the profession. These applicants possess a 
personal and Intellectual naturlty lacking in undergraduates. Ihe large pool 
of applicants and the selectivity of graduate adaisslons has the overall effect 
of Improving the intellectufil caliber of the professional field. Hence, the 
quality of 'Basic fbster's' students is NOT negatively influexed by the 
'structural degree abnormality'. 

The effect on 'Advanced Haater's' applicants nay be quite different, how- 
ever, particularly if the master's degree is the tensinal degree in the field. 
Advanced professional education ftilfils the function of' educating specialists 

to apply the body of bouledge, scholars to advance it, and teachers to trans- 

1 

nit It. If the 'Basic Ifaster's' track is perceived as depreciating the 
master's degree in a professional field, potential 'Advanced Haster^s* appli- 
cants will prefer programs In other disciplines. Thus, the profession Is 
deprived of Itadership potential. 

Considerable time has already been aevot d to relating the 'structural 
degree abnomallty' to the next quality indicator, the curriculum. Devising a 
structure to acconiiodate diverse applicant backgrounds, requires clearly 
speQjfled hierarchical objectives for basic professional, advanced professional, 
and graduate educational objectives. Initially in program planning, It 
kould seem preferable to sequence rather than integrate the basic and advanced 
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elements, Once the 'Basic Hester's' complete the core courses, they 

can be tracked with the 'Advanced Haster'a' for advanced and graduate edxatlon. 
The high Intellectual caliber of tho 'Basic Piaster's' students is then challenged 
by a curriculum attuned to his/her abilities. This' structure avoido having to 
establish tw separate, and questionably comparable, curricula. It also es- 
Ub)i&hes an interdisciplinary clin^te. Hie 'Basic llasLer's' studonta liave an 
undergraduate mm'i of knowledg<} in en academic discipline, lacking In the 
'Advanced Haster''j'ritudents they can bring to bear on professional Issues. 
Similarly, the 'Adv»Mi;ed' sludonts can share their experiential learning and 
facilitate i\\6 Ir.tegratlun of theory and practice for the 'Basic' students. The 
propoj^ijd currlcuuT plan thus has positive implications for both categories of 

The firifli qualitif indicator is faculty. The 'structural degree abnormal- 
ity' rmliu in pwtlcuiarly negative consequences if tho master's tegroe is the 
terminal degree in that field. In this case, although 'Basic Master's' gradu- , 
ate.* have a restricted view of professional concepts, issues, and practices, 
they qualify for faculty positions, Hence, these narrowly educated professionals 
bvcoloe the oodels of the young. This situation can establish a cycle that limits 
the effectiveness of practitioners and retards knowledge devalopment. This \ 
cycle can be reversed by adding the advanced conponent to the 'Basic Hosier's' 
curriculum. The quality of faculty arising from 'Advanced fester's' programs 
would remain relatively unchanged by the curricular rovisions, unless the ad- 
vanced professional core la enriched by courses in the liberal arts. 

Quality Control , tip to the present, most steps to correct or avoid dual 
master's level credentlaling appear to have arisen from within a profession, 
via specialized accreditation, rather than within academla, via either general 
accreditation or self-study. This presents an interesting situation since the 
problem exists in academic certification, which is clearly the perogatlve of 
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a Institution. As the nuober of *Basic Ftaater*a* dt'J<ients in- 
irofesaion, and their impact begins to be felt, confusion Is gcn- 
Blnds of professionals, within and allied to that profession; 
1 recipients of services, regarding the qualifications of these 

5nce, the profession begins to exOi I constructive pressure on the 

I? 

' curricular change. This action nay be perceived as intrusive 
lity. 

ny contention that niore preventative, assertive action, to 
irdo on the part of those administering graduate education is not 
, but would be welcomed. The baccalaureate level or emerging 
re relatively new to campus. This, coupled with the *rainda in a 
Lttion of professional schools or departnonts, results in an 
with many aspects of the acadenic environnent. This lack of 
l>3uld be Biet with a more collaborative curricular planning rela- 
sen the graduate administration and the prbfessional department, 
tlon Is intended to focua on the structural aspects of the degree 
aal curriculum and not on its specific content or processes, 
tjtion in several broad areas appears desirable. The crux of re- 
031 ioaster'B standards lies in devising a curricular structure 
ditee diverse educational backgrounds. This necessitates a 
alsal of student capabilities at admission. Once this has been 
li/idual skills and abilities must be matched with a flexible 
Learning formats such as self-paced study, concentrated learning, 
itudy, seminar- tutorial, .and problem-centered study (Schein, 1972} 
ich flexibility. The organizing principle for curricular re- 
inwrges from the competencies desired of the practitioner operating 
led professional level. Once these are defined, learning exper- 
I ."ormulated to accomplish them. The image of curriculum building 
inced to the basic level, rather than from the basic to the ad- 

/ 



vanced, is critical and involves an essential gestalt switch. The ijoal ia to 
arrive at a re -conceptualization of the curricular units rather thnn a mere 
re-arrangement of il^s parts. 

In conclusion, I have spoken as an educator in a baccalaureate level 
profession, in favor of structural supports for academic excellence, A master's « 
degree is a master's degree and should not be qualified by a basic or advanced 
knowledge base. Structure determines function, Realigning the advanced pro- 
fessional curriculum with th^i master's degree is designed to enhance 
competence in scholarly inquiry, as well as, professional skill. 
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"HASTER*S PROGRAMS IN THE HUHANITIES" 



Calhoun Win ton 
Oepartnent of English, Univ. of Maryland, College Park 

ad this paper over and expressed eone alen at the sarcastic tone she 
Is In the real estate business and thus an Ideallit, who does not see 
of Life, but I assured her snd sssure you that uy cusnents, though 
tfltli exasperation, are those of a lover of and true believer In grad- 
ing observations on aaster's prograas In the hunanltles sre obviously 
—there is no blbllogrsphy-^but they are based on lapresslons derived 
f alaost twenty years' Involvement In auch prograns, as graduate fac- 
aditlnlstrator, These Included "pure**, or departnental, prograas as 
partnental and Inter Institutional prograu. I should qualify the 
otliig that all this experience was gained In universities which also 
tornte. Whether the observatlona wuuld be valid In an Institution, 
r'.s Is the highest degree awarded I do not know, 
itlcs which grant the Ph.D. concern over the doctoral prograns has 
baeeslve; very little time or thought Is expended on Master's pro- 
e fccultles, when they think about the* at all, are Inclined to regard 
ner of a noble Engllshlandlord viewing hla poor coualna resident on 
ley &re acknowledged as his but with the vagus wlsh^ that they would * 
Graduate faculties have sonethlng »ora ispottsnt to do, they feel; 
ibout the aaster's degree: that la to say, the Important business of 
irates. And yet, Interestingly enough, while enroUnents for the doc- 
in In a reDorselesa decline — for very good reasons — waster's pro- 
: relations, have held renarkably ateady In aany fields Including my 
I truth were told, sre In fact carrying, or keeping alive, nany a 
I progran. Furthernore, the benign neglect produced by focussing on 
:he doctorate has allowed soae Interesting experlnentatlon anong 
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adRter's prograas. Since nobody cares about then they have been free to develop and 
flourish; whereas, let a graduate director attempt to neddle with one of the sacred 
totens of the doctorsl program without extreme circumspection the foreign lan- 
guage requirement, let us ssy — snd his days In the job will be numbered. 

Certsln general objectives, I would ar.gue, have emerged among master's programa 
In the humanities, even though the objectives hsve perhapa not been Identified as 
such. Programs have been developed In reaponse to certain demands or on a few rare 
occasions have even been planned because they were seen to be dealrsble educational 
policy. We realise, If we reflect on the matter, that we are effecting some things 
on the master's level. Why should we not recognize these things snd get credit for 
having objectives, even if our behavior has been more like a chicken In a farmyard, 
; pecking here and there for sustenance? I would suaaiarlze these objectives as Inclu- 
ding: (1) providing general education, (2) providing a winnowing mechanism for 
selecting doctorsl csndldates, and (3) providing quasi-vocational education. Some 
programs attempt all three of these, many only one or two. 

the rejuvenation of the master's degree as a medium of gertcral education la pro- 
bably associated with the fragnentatlon of the typical undergraduate curriculum over 
the last decade or lo, and tha virtual disappearance of general education require- 
ments at many schools. I suspect, but cannot prove, that these conditions affect 
the humanities more seriously than other fields; courses In the sciences or even the 
performing arts such as music or dance are, I would think, neceasarlly more sequential 
than those In the humanities where tl^ smorgaabord approach to education operates to 
s grotesque degree. An undergraduate In the humanities may be taking In a given semei 
ter, say, courses In medlevsl English Uteratjre, stsge lighting, msrrlsge and the 
family, and the history of India, with on sssortment slmllnrly vsrled, equally unco- 
ordinated, and entirely different the next semester. A student majoring In English 
nay well emerge from college without having read a plsy of Sliakespesre or « novel of 

student 



Dickens or Psulkner or a poesref Keats. Or perhsps the student wjored In a field 
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M'cluKtirwl vltb riquirciiQti that thin uai no tin for couriei Id the huaanltlei, 
•viQ if hi or the umtad to inroll in thn.^ For varloui reaiona, than, uny holderi 
of tba baccalauruta theaa daya faal that ^alr undiriraduata education vaa Inade- 
yiata or locoaplatu* Quite often they ere ciployed fulhtiu In non-acadeBlc pur- 
ittlta or are houaivlvee returnlnf to achool or are retired peraone; in any ceee they 
hire BO Tocatlooal/objactivae lovolvlnt their degree itudlee. They ere there for 
tki but of rMaomi, the love of leemlng. Significant nmlere of theee etudente 
He POM epplyiog for greduete uork but the graduete faculty doee not, on the uhole, 
fircaln their preaeDce and certelnly doce little to aae|iC their progreea toverd e 
Itgret. There Ir of ten, it le true, e problei eeeocleted ylth etudente luch ee theee 
btUQM of Inidaquate preparetlon; ere ve not lotfering our etandardi If ua let tha 
iitl Thte can be eaally reaoliid by provlaional adilaaloo:' let tbea prove theiaelvee 
wdir fire, eo to epiak, before they ire ediltted to e full degree progru. Hany of 
tket, by virtue of their Mturity end general experience in living, will turnout to 
U neellint etudente If ly obeervetion le any guide. 

The Itaduaka faculty le ecutely avere of the aecond of the three cbjectlvea of 
f laater'a progrei aa 1 have outlined tbei, to eane ee e vlnnoulng Mchanlai for 
doctoral candldatav. Thle, Indeed, hlte the greduete faculty where it llvae. A 
paduata director le beeleged vlth coiplelnte about thle etudent or pleee for the 
Meietence ol that etudent, ae the faculty fulfllla vhat it takee to be Ite prlMry 
■ieelon, to reproduce Iteelf . Feculty leibere often do not perceive, or vlgoroual^ 
4My, that that le vhet they ere doing, even ee they go ehout It. ^u, I don't vent 
CO aea to be putting eny preiwre," they lay aay, "but Hr. I la the beat student I 
have bad In ly aalner In yeara." Tranalated freely thlfl leana, "He hea the aaae 
litellactual ekllla I have." Nov, there la nothing Intrlnalcally evil about thia - 
licept ae it contributee to the exduelon of ilnorltlea and uaien, "^hlch la plenty 
nil. Tha traniiiiialon of Intellectual aklUa le of courae a prliary objective of 
graduate educetlon generally. But to think of a laater'a prograa aa prliarlly a , 
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uiniiQwing device for doctoral candldatee, to say that the prograa. exlata for that 

purpoflo, la to rob the progren of Ite intellectual content, to isake It a aort of 

extended candidacy exanlnatlon, and to confer aecond-claaa cltitenBhip on thoae not 

judged to be ''good enough" to be r doctor of phlloaophy - nany of uhoi have not the 

allghteet Intereet in beconing eeid doctor of phlloaophy. 

Related to thia la of courae the queetlon whether graduate facultlee ihould be 

80 lealoua In replicating tbeuelvee, et e tloa when, in ay field, it le itetiatl- 

C4lly certain that fifty percent or tore of the eLudenta auarded doctoral degreei 

ulll not find perianent aadcilc nployient., gut the obeeeeive concern ebout the 

doctoral progru, to vhlch I alluded earlier, hai deep piychologlcal roota and la 

not a problei that vlll conveniently liquidate iteelf. In e reauarch departient 

there le e quaai-parent/chlld relatlonablp batveen graduate faculty and doctoral etu^ 

dentBi In e eubtle but genuine eenee theee etudente are thought of aa carrying on 

the tradltlona of leernlng end echolerebip vhlch ve, the faculty, have inherited froi 

our ovn echolarly lentore. Thle le en ettltude lo pervaaive that it la difficult to 

and I 

counter. The chalnan of our depertien;/ recently ehended e conference of chalnan 
end graduate dlrectore In the South Atlantic region, on finding non-acadeilc ciploy- 
lent for our greduete etudente. Hy cheinan pointed out the Intcreating fact that 
everyone there eeauud the etudente in queetlon vere doctoral etudente; in fact, vhen 
aha brought up the queetlon of laater'a etudente finding joba there w-i e long and 
eibarraaalng eilencr. No-one vented to eddreea the problei, or indeed, adiit that 
there vaa a probln. Thia la an attitude that will be difficult to change and It 
colore tha thinking of lany faculty leiabera, vho vlU peralat in believing that the 
prlaary objective, the only proper objective of a laater'a prograa la to identify 
those vho are beat aulted to go on for e doctorate. 

There baa been e good dea) of deund for, end aoae interesting experiaentatlon 
in, progrwi which puraue the third objective I heve apoken of, the quaai-vocational 
prograi. Theee coeibine the objective of general education with the objective of 
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•irnlni i llvlni, ind hart iri to be found im of the lOit Innovitlvo progrwi in 
iriduite •ducitlon todiy. Dibib iddrwi directly the queitlon, vhat doa< one do 
vlth e degree In the huunltleeT 

Perhipe the oldeet ind loet thoroughly teeted of thiie progroii le the venera- 
ble uitet of arte 1b teechlng (the MAT), Deelgned for thoee In or hoping to enter 
Meogdiiy tducitlon, thtn off«c irdMi itudy In tin ptliiry fJeld of learning 
iloni with eoutiei uhleh ni Intmdid to futthir the profeiiloml developMnt of the 
etudent. Otdlnitlly thli degree li offered by i huunltlei depittient In collibor- 
itlog with the echool of educitlon. Johni Hopklni vie, I belleve, e pioneer In thli 
degree progra end It hie been widely edopted, with greet lucceee In uny plecee. 
inothir IflterdepiftMntil prograi le thet here et the Unlverelty of Marylind In «hlch 
the Depertient of Hletory end the College of Library end Inforiatlon Servlcee have 
coiblDid reiourcee to produce a Joint Meter 'e degree, the recipient of which le 
trained for poeltlone euch ae erchlvlet, lanuecrlpte UbrarUn, end the like. The 
Unlverelty of South CeroUna le Juat adv preparing to offer a Meeter of Builnaaa 
Adilniatretlon which hee ee an optional coiponent graduate coureeo In the huMnltlea, 
taught by the regular huiiDltlee departaent^. 

Two mil but Intereetlng Interlnetltutlonel ueterU progrwe ere to be found 

la Delewire, the Eleutherlan Mille-Bagley progru In the hlatory of technology and 

the yinterthur progrn In early Aierlcen culture. In both caeee faulty leibere at 

the Unlverelty of Oelavere colleborate with etaff lobere at the reapectlve luae- 

we (Hagley and Wlnterthur). Theee prograia are delklted chronologically by the 

Unite 

perlode covered in the reapectlve wieuw' collectlone. Within thoee chronological/ 
regular graduate couraee are offered In the acadetlc wbject areae (English, hlatory, 
ert hletoty, end eo on) and luaeifli trrinlng coureea are.provlded by the Bueeun ataffa. 
Tbeie prograa have had outetindlng euccese In placing their graduatea, my of vhoM 
have rlaan through the ranka to poeltlone of euthorlty in lueeuifl and hlatorlcal 
eodetleee 



In all canior I luat adnlt that prograu euch aa chese face fornidable obetadee. 
One iliould never uuleraetliate the aheer labor of getting agreenent on the currlculM 
between departoenta, coUegee or even Inatltutlona with quite varying aenaee of ile*^ 
Blon. Staffing la likely to be e perpetuel probleii finding faculty with the necea- 
aary flair and enthualaei for InterdleclpUnary atudlea le not eeay, and an apathetic 
etaff can quickly kill a pragru. And funding le of courae alwaya likely to be or 
becone en leaue: a program which wee the apple of one unlverelty prealdentU eye 
lay be e lote In the eye of hie eucceaeor, Finally, there la faculty hoetlllly. All 
prograva euch ae theee, u I have eeld^ ettenpt to find anauera to the queatlon, Uhet 
doea one do with e degree In the hiaenltleef Many graduate faculty lenbera find thle 
queetlon offenelve on Ite fece. One doeen*t dojnythlng with a degree In the huien- 
Itlea, they would argue (eicept perbape teach, elnce thet le vhat they do). The 
degree le e waaure of Intellectuel acbleveMnt, of end by Itaelf, eelf-juetlfled and 
eelf-Juatlfylnge The vocetlonil eapecte of prograu euch ee I have deacrlbed leny 
feculty seabera find repellent* Nevertheleae, nothing eucceeda like aucceee end we 
can expect Increaeed Intereet aiong itudenta pureulng thle third objective) who went 
to etudy further the eubject which they have cone to love and yet who would alao like 
to find eteady enployienti with peydeye. 

Vhat of the future? I believe greduete departsente In the hunanltlee ehould 
continue to puraue ell three objectivee, though ea ny tone and nanner of preaentetlon 
no doubt indicated I wleh graduate faculty neibare In the huaanltlea generally would 
treat thoee of general education end quaal-vocatlonal education eorcwhat nore eynpa- 
tbetlcally and would nlnlslie the faahlonabla handwrlnglng about our "plight." Ai 
they need to eay In the eervlce, thlnga are tough ell over. Graduate education can 
grow and flourlah In l^en yeara ae well aa fat ooee If we uae the brain? we have been 
given, which we have euppoaedly trained to auch e peak of perfection. 



Calhoun Uinton 

Director of Graduate Studlee 

DepartienC of Eogllah 

Unlverelty of Haryleod, College Perk 
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m HASTIR'6 DBOREB IN TliE BOCIOIOGICAI. ENTERFRiaE 

Julii Uonnold 
(Virginii CownviiUh Unlvariity) 

AlUn Bchvartibaw 
(Virginia CoMonwiUh Univeriity) 

Tbi 901I of ihii coDferance ii to men thi current roU and voaning of the 
iatar'a digrae. Since higher education operatai aa an interdependent ayBtea, 
ti evaluation of one coioponent puat take into conaideration Ita relationahip to 
he other parte of the ayatei. The laater'a degree ia uni<iua in that it larvea 
« a lihk, a kind of gateway joining undergraduate education to doctoral level 
iraduata atudy. Jin exaiination of the role of the laeter'a degree ahould conalder 
he variouB patha Joining bachelor^a to doctoral degreaai through the intenaediate 
laatire level. 

/ Heater* e prograia vary in the extant to which they are integrated with 
loctorel level prograia. Btudenta uaing the uater*i aa a bridge to the doctorate 
lie not peiiing through identical gatewaya. Hence, ve need to exaiine the career 
Aplicationi of enrollMnk in different typea of iaater'a prograxa. Furtheri the 
m iaater*e progcai lay have a diverae ii^ect on different categorlea of atudenta. 

Ultliately, our analyaia luat grapple with ujor queationa of the value of 
;he iMiter'a degree Itaelf,. Under what; circtnitancea ie poeieiaion of I leiter'a 
done fufflcient cueer preparation? Nhat career dieadvantagea do Individuala 
ilthout a doctorati encounter? Any exaslnation of the laitar'a degree, however, 
la imediately coopllcated by aubttantial differences anong the various 
liaclplinefl and profeaaione. The goala, nethoda, and ei^icatlonal requirements 
)f acadexic and prDfeeeional groupa are bo diverae that any attenpt at general- 
lutlon ia aeciouely liiited. 

Our paper ie baeed on a secondary analyaia of the infonation reported in 
bhe 1975/1976 Dire<:tory of the American Sociological Aaaociation.^ By focusing 
3n thia single population, ve avoid the probleia associated with trying to 



genariliie acroai different groups. He also hope to deoonatrate the potential 
of profesaional directorlea and leiberihip lista for reaoarch and policy analysis 
in higher education. Of course, our approach is liiited to a coneidoration of 
thoae Itene reported in the Directory. Answers to nuiny of the quostions un- 
resolved by our study will have to await follovup prlsiary data gathering efforts. 

The Haater's Pepe aa linking Pin 

Of all the laatar'a prograia in eooiology, relatively few offer a H.8. . 
degree. Offering the N.8. instead of tlie H.A. aeeia nainly to be a result of 
historical factors. Howevsr, in soaw caasa, the H.S. ia a wre quantitatively 
oriented, technical degree progru. Vhen we eiuine noveoent froei the bachelor U 
to the siaster's degree (rlgura 1), vi find that studente with a B.S. sre^ 
aignlficantly 17-43.56, p<.0001| lora likely to enter H.S. programs than B.A. 
atudenta. Thia difference holda whether we coneider etulenta who have gone to 
the sm achool between the baohelor^a end nasterU or those who have switched 
schools. Vhile both the nuibera Involved in qur sasiple and the unknown 
repreaentativeneas of the directory lietinge for the population of professional 
sociologists necessitate conaiderable caution in interpreting results, the 
findings do raiae the qaeatlon of the syfebolic and content differences between 
the two types of prograia. 

Figure 1 charts the eight poeslble patha froo bachelor's through aaster'a 
to the doctoral degree. Anong these A.8.A. sieMbers, educational petha vary 
in the probability of atuining the doctorate. The siost efficacious sequence 
to a doctorate ie via D.S. and H.S. degrees (4.31 dropout rate). The least 
effective path is via B.A. and H.S. degrees (31.61 dropout rate). Vhether a 
student starta with the B.A. or the B.S., his/her greatest chance of continuing 
is with the analogous Master's degree (M.S. for fi.S. studentsi H.A. for B.A. 
students). If the content of the "ecience" degrees ia indeed store technical 
than that of the "arte" degreee, studente switching froi B.A. to H.S. should 



havi uri dKc-iCUlty in idjuiting to tha currlculuH thah itudenta who atteispt 
thi H.A. iftir Ihi B.a. In tnct, dropout ratii ar« higher in our aanple for 
t|w D.A.-H.a, routa. Claarly, the uater'i in loololoqy hai dlffatflntlAl inp/ict 
on atudant carneri, depandlng on typa of dagraa progr&i ind nay In other 
diaciplinai at mil. 

Another factor to conilder in charting *oduc4tlonal patha la the extent of 
regional and achool !»)bility. Aftar obtaining a bachalor'a degree, itudenta 
are alnoat aqually split batvean thoaa aalactlng an in-atate (49l| veraua an 
out-oC^atata (51l) Maver'a prograa. But once anrolled in a naatar'a prograi, 
a little under tw out three itudenta (62l| will opt for a doctoral progras 
In tha aa«a atata. Alwt^t all of thoaa reuining In the Bane atata (96M 
loved into a doctoral progran in the aaia school. Table 1 ihowa the distri- 
bution of our u«pla of Aa^rican Sociological Aaaociation lenbera according to 
type of inte:-Khool wbility. Tha noat typical pattern la to change achoola 
after the bachelor 'a degree and then renaln through tha feaatar'a to the doctorate. 
It la vary unconaon to attend tha eaie inatitution for the bachelor'i and 
doctorate, while aelecting a different educational aatting for the naater^a. 

Table 1 ilao preienti the proportion of atudenta In each category vho 
cotfpLeted all of their undergraduate and graduate education in nine yeara or 
leaa. While attending a different inatitution for each degree aay have certain 
advantagea, auch aa broadening one 'a frase of reference, it aubstantially 
^aiowa the rate of progreaa through tho educational ayatea. 

An additional path toward a doctorate ia to bypaaa tha aaatar'a altogether. 
Only 131 (76) of A.S.A. aeaberi holding doctoratea have diapenaed with a 
laatar'a degree, the oniaaion of tha aaater'a for thla group has had aeealngly 
very little practical effect.^ The only rolationahip we could discover (of the 
Hat of tested relationships in Table' 21 was a greater tendency for doctorate 
holding sociologists with a aaster'a to be departaent chairpersona. 
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The VftliiQ of the Haator'a 

No Right eiipeot the lapllcationa of not twlding the ductoratu to be 
griater, tiowo\^er. A.S.A. neabers wIk) have s iaster's aa their highest dirtrQa 
are difforent in several wayi frot tliose Mho luive earned docLoratqq (Table 2)/ 
FeoAlaa are auch leaa likely than aalaa to posieaa s dootorato. Individuals 
with only s Raster's are aore likely to occupy tha nore peripheral position of 
aasociata aenber within tha aoclaty. (As aasociates they are unable to vote 
or hold office* I Ph.D. 'a as a group are alao older (average age of 43 yeara 
for Ph.D. '8, as cocpared to 40 for aaster'si t(219)«3.e5, p*.OOS}. Self* 
identified Ph.D. candidatea are not included in thia analyala and bo do not 
account for this difference. (Student A.S.A, neobera and associates were not 
coded in the atudy.) Aaaoclation leobera who possess the aaater's aa the 
highest degree sbo evidence significant differences in their career patterna. 
They are auch iora likely to be eaployed outaida of acadeala. Hithin acadeaia 
they are concentrated In the lower ranka. The difference in rank .between 
doctoral and aaater's holders is aaintained when controlling for age, though 
the only full professors with naiter's degrees are anong the older cohort 
(bom in 1933 or before). In addition/ within acadeala aaster'a holders are 
aore likely to occupy a reaearch poaition. 

Type of Master's Degree 

Among master's prograaa, an Inportant diatinction ia between those 

universities where the aaster'a ia the highest degree and those where It is 
t 

one phase of a doctoral program. He have discussed this distinction in an 
earlier article.^ Our current analysis has allowed us to aake aoae additional 
obaervationa about tha two types of prograas. 

Results displayed in Table 2 show aeveral differences between Ph.D. 
sociologists, depending on whether they obtained the aaater's degree in s 
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inlnil or nontinlnil diqrii progrM. Cwpiru to tlioii who ittandod 

onUrvlnil progrwii M.DJi vho coiiplitid i niitir'i it i tinlnil Initltutlon 

ri youngir ind'concintratfld In tho \om rinki til loiduli. N^lthir of thais 

Kdrincii ii it.itlitloilly ilgnKlcint, homir, bioiuii thi nuibir of tarnlnil 
1 

igrii holdixi li mil (n«34). Profiiilonil io9lBlliation outoonii an broidly 
lidlir, ilnci timlnil Ph.D.^i ici no mt llkily to U uployid in i non* 
didnic iitt'Dg. ThoN ittindlng tinlnil progrui urn thilr Miter'i degrii 
QMvhAt lori quiuklyr iikI tin p«rlodi (roa thi bachilor'i to doctoral digraii 
0 not difCA!. Thi tminal digrii prograi uy thui provida thi luxury of a 
Ui'lng frotind," wbici itudinti can axplori othir cariar optloni, without 
oi, Ittlng nt * tlM to conplati tha dootorata. It lay alao ba tha oaaa, of 
ouraa, that ttninil mtar'l prograaa ara laaa Intallaotually deundlng and 

0 riqulra laaa tlia to coiplati. 

Hovaver, ittdivHng a tirvlnal laatar'a proyru can aftact tha probability 
i( aiming t do<iton\ta for cactaln typaa of atudanta. Milaa ara alioit 
q'-lly llkaly to ^oaplata the Ph.D. whathar thay attandail a tamlnal (BOM 
ir nontanlnal dagrae prograi, Tha tamlnal laatar'a prograi iota aa 

1 <|raatar ratacdint for faialai; 461 go on to tha doctorata fron tanlnal 
irograii, a.i coMparad to 66^ froa nontaitlnal prograii |p«.QS3). Ganaral- 
lutlon of "M% rinding la hazardoua, linca so fav faaialaa attend teralnal 
iro^raii (n'M). further reaearch on tha affect of different typei of graduate 
)ro9raie on different typei of etudente la neededi 

For Mat etueente froa both teninal and nontanlnal degree prograia, the 
fh.r itlU appeara to be viewed as a neceasary attainMnt for a profesaional 
K)clologlit. A MlniMun of W of tha graduatea frooi either of the two typee 
)l i/.itec'a progriia elected to go on for tha doctorate for two tlna perlodi 
n conaidered. ror thoaa who earned a haster^e prior to 1963, however, enroll* 
Mnt In a nontenlnai progras waa tantaaount to eventually earning a Ph.D. 



W\ flniihed tha dootoratel. Thla waa not ai true at that tlno for lernliial 
nuater'e graduitoa |7U eventually eernod tha Ph.D,i p",06| cotnpared tn naih 
tjriilAal program). 0ince 1963 the peroeDtagae of naater'a holdara going an 
for tiie dootorata froi both typaa of prografei ara nore alilUr froi noii- 
tanliuil and 691 froi tamlnal prograiii p7.93), Only for maatar'e etudinti 
inrolled In nontarnlnal progrua haa tha dropout rate Increaied ilgnlflcantly 
alnce 196] (10) for 1963 or before, ae coapared to 261 recently) 32, 
p<.0001). 

Our itrong iipreieion, baaed on our earlier work, la that the reaaone for 
not continuing ara vary different In the two ceaee, Studenta in a nontarnlnal 
prograa oparete In a nomatlve olliata where Ph.D. oandidatae are granted tha 
hlgheet atatue aaong etudente, and thoaa who atop at the Daater'e level vlU be 
eeen aa profeeilonally Incoapitent. Thie norvatlve anvlorniient oreatee itrong 
preeeuree to continue on to the doctorate. Studente In auch progradi do not 
often teninate their education voluntarily. A decleion to etop at the Materia 
level le aoat often e reeult of external factora. Poc axuspla, recant reduotlona 
In unlvareity and departiental budgete have curtailed the number of atipendi 
and fallowihlpa in aany graduate prograie. Thle dlalnutlon of fundi hae. In 
turn, cauied faculty to aore etrlngently acreen applicanta for financial eupport. 
The etudente In a nonterainil prograa 9ho do not continue are frequently 
"reluctant dropouti." 

In ccntraetp etudenti inter taralnal prograni recognising at the outeet 
that there le a good poieiblllty that they will not continue beyond the naater'a. 
In fact, a portion of thiaa etudente view the aaater'a ee a lechanlaa for 
advancing a career they have elready begun. In addition^ as aentloned above, 
other itudenti eniolied In texalnal prograaa are interested In 'testing the 
water" In order to aiieae their luitabllity for doctoral level work. Hence, 
when itudente In terainal prograaa atop at the aaater'g level, they are 



probibly luoli wcii Ukily fco do lo valuntirlly. Thiii^ MU M\ typiN n( 
profrMi outtintly produci longlily iful proiwrtlani of liwIlvWuili with tli« 
mtir^i II thi h:.ghiit diyrHi tin iMpUuitloni in qiilti aiftirint. (( 
tliiu chiriotiriiiitioni in cornet, ituilinti vho do not vuwiUm In iinii- 
tirnlnil p(o{riiii in mei likily to inirgi with niyitlvi riilli^i ilioiit 
thmilvii, thi pi'oCiiiion, and pichipi lU o( hlghir iduoitlon. iThoio who 
hold ttM Mitir'i II thi highlit digm in ion llkily to ingigi In non^ 
acidiilo vork thin Ph.D.'ii ii dliouiiid iirllir. Thli oholci My U lun 
I iittir of neciiilty thih diiln for thou who drop out of nontinlnil progcui. 
^Ki thli itigi, out intirpntitlon li liigily conjioturil. Of courii, our 
hypothiili li AMnibli to tilting with ittltudlnil diti In futun niiicch. 
Otvtn thi iilitlng (InincUl iltuitlon, In coa^lnitlon with thi projictloni 
of I continuing ovinupply of Ph.D.*i In virloui flildi, tinlnil mtir'i 
progrm Riy hivi cirtiln idvantigii ovir thilr nontininal countirparti In 
thi profiiilonal loclilliatlon prociii. 



Conduilon 

In loclology, ai In other dliclpllniii thi long tan Incraaie In thi nunber 
of Fh.O.U dwardid hai downgradid thi Mitir'i dagni. Caught ai It li batwein 
ilnlul Ibaohilor'i) ind laxiial Idoctonl) pcofiiilonal training, Iti i«pocUnca 
ind cirier liplicatloni havi nsainad nibuloui. Our itudy dwonitratei, howovir, 
that tha ustir'i hai a unlqui and potintlally iiportant roll In thi devslopiant 
of itudent cjraari and profiiilonal Identltiei. furthir taiiarch ihould aiieii 
Mri dinctly praitint and poiilble futun roln of thi dagree for participants 
in hlgbir aducitlon. 
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1, Tha A«arloan lloplnloglnal Mioolat|on, lj)?S /lQ76 Dlnuior y of Mm * 
HAililngton, O.C.i UXi Ni lyitiiitlaiUy mmplid lOl of thi 
pagei of tin dinatory, coding Infonatlnn on all nwoi on i ^^^^V^ 
that nuorded for Intirnitlonil inbin and iiioolitii ind itudont iwhari 
ami aaitiolatii. Thai, tha riiulti of our itudy can only ha goniraiUid to 
loalologliti In tin Mjor aotfva lanhirililp catigorlia wIki rii|Ktndi(| Ui 
thi j\,a.A/i nquiit for infonatlon and mt to ill profiiilonal looloo 
logliti. 

2. In till Unltid Statai, 101 of M gciduata dipartmanti of faring naitir^i 
digriii confir thi H.A. digrii W\) (Miirloin Soolologloal Maoolitlon, 
GuIJa to Qraduata Dayirtiantl . Hiihlngton, D,C.i l97fi). Ton 
(Si) confir thi H.fi. digrii^ ind iivin (3M will confar ilthar tha Hi. 
or N.B. 

3 Till filling of no ilgnlfiomt dl^finncti aiohg Ph,0. looiolociliti with 
V Z^i Mitic'i .ccordlng to Imgth of tin fro. tha bachilor'i to 
J r^^^^ thi lUuatlort of oUnlcil piycholog iti. m e 
a tli ind Elchhorn (1961) found that clinical piyohologlit. ^^^^ 
. l!-^ir>. iDint about two ion yiiri on tbi avingi batwiin the bachelor i 
:i a^^^^ O.J. Blcton, -Lirgth of Ondua. 

nalnlng for ExpirlNntal and Clinical Piyctologliti/ AHliSi!^^ 
16, mitllB^lBOI. 

6. in thi Unitrf SUtM, M ot «9 gtiduiti JipttUenti offer » M>t«'i ii 
th.li hl9h.ll dmi. m (A.8.*., Qul.l.toCHdu»te D.p^rt».nt., 1 6). 
on. hundiid t«n (53»l off.i th. Ph.D. with th. mttt'i, and flv. (2 ) 
offei thi »h.O. lion.. Ihui, of Ph.D. lohooli, 95» off.t thi laitH i 
.IK ind only i\ mlt th. Mit.r'i. Thi. li viry dlff.nnt froi piyohology. 
whit. M» of Ph.D. prcttt. do not off.r . ..i*r.t. ...;«•. ^ 
511 riqulri th. itudint to obtiln . mtu'i. (Robart J. Hov.ll «rf toxin 
I. Hurdock, "Ih. (M.itlon.bli V.lu. of • Haitii'l m» lot . " 
siudint," fMr |c!!n P.vcholo.t.t (July), 196J.60-65U. N. h»v. no c«p.t.bl. 
InfotMtlon on daflte. tKpilrwnti In loololofly. 

6. JuU. Honnold.D. P.ul JohnMn, Hubirt H. Oppa, and Ml.n SehwrUbiu., 
"Thi Hiinln, ot thi Sociology Kaatir'. 0.9t..." Southitn Soclolojl.t B 
ISptlng), 1917 1 5-7. 
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T«bii I. Intar-iGbool HoblUty to thi Ph,D, In Boolology 



fypi of ]ntflr*&ohool 
loblUty 



toitir'ii dootorata faiei 
Uchilor'a dLffacant Khool 

laohalor'ii Matat*!, 
dootorata diffatent achoola 

lachalor'ai laitar'a am} 
dootorata different achool 

Saohalor'i, laatar'a, 
dootorata use aohool 

Bachflor'af dootorata lanei 
Mitar*a different ichool 
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1957 or before i2\ 
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THE CMICUUI OniOH APPWAQI 
TO lUI DESIGN OF WSTU'S DEGIEE FKOGIANS 

by 

Aaodore Clavengir, Jr. i Dean 
College of CoMunlcation 
Florida Stata Unharaitr 

IVo brsad lodala beve doilnated griduatt icadeilc programing 
throughout tha racent piiti the plgeonhola aodel which placaa atudenta 
and faculty In lutually-exdualve tategoriea and the wheel wdel which 
Idantifiai a core of required knowledge lying at the hub of the 
dlacipllne ilong with aevaral apecialltatlona which are concalved aa 
apokea raillitlng away frot tha hub. IWa paper will praaent a third 
altarnatlvet the .^urrlcular option^^ approach. 
' flia aaiantlal prerequliite to tha currlcular option approach la 
tha aKlatan:e within i departient (or group of coiwnlcating dapartienta) 
of a highly divaraiflad let of couraea which light be conlilned in 
dlffttint *r|ya to aervc ilatlnctively dlffarent educational or career 
goala. To l^)laient the wdel. the faculty flrit identiflea all of the 
different educational and/or career goala which tha prograt tight aerve. 
It then apeclflaa tha particular knowledge and akiUa needed to reallia 
each goal, Ihli aet of knowladga and iklU requiretenta for a given 
goal (or (iloaaly-nlatad aet of goala) then rigoroualy directe the 
aelactlon of couraea froM the available pool to conatltuta a currlcular 
option. A departient which forwrly offered one degree program with 
dlverae and dlffuaa goala now will offer aeveral different currlcular 



r 

optloni, each with Ita own apeclflc goali and atructure. 

It la inportant to e^)haalie that It la the career goala, not 
the extant currlculm nor definition of the field or dlacipllne vhich 
deteninea the courae content of each currlcular option, Thui if a 
career goal deianda a gl|en aklU which la not available in the depart^ 
■enti but la available ileewhera in the unlveralty, the Walde" 
courae ii deflneHnto the currlcular option - after due conaultatlon 
with faculty to the lipacted department to agaure adequate courae 
capacity and atudent coepatlblUty, By the aaie token, If a career 
goal deianda knowledge within the dlacipllne which calla for nodlflcatlon 
of an exlatlng courae or creation of a new one, the courae developaent 
la carried out - provided that the urglnal coata are not too high» 
aa we note below. 

The aaaence of the currlcular option approach la to provide the 
atudent with a wide range of different educational and career goala 
froi which to chooae within the broad field of itudy. In lact^ initial 
faculty end adilnietratlve reactloQ to the proliferating Hat of coreer 
goala ia that no aingle prograi poaalbly could provide auch dlveralty 
without a vaat expanalon of faculty and flacal reiourcea. Thla reaction 
la not lerely probable, It ia virtually Inevitable, becauae of the 
perfectly natural tendency to perceive curriculiu in tana of either 
the pigeonhole or the wheel Mdel. Firat reectiona will be baead on 
the aaaucption that either a aeparate de^rtKUt and faculty ttuat be 
created to aerve each career or educational goal (pigeonhole lodel) or 
that a very large depertient tuat be created with a divlaion correapondlng 
to each goal (wheel aodel) . 
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lb« currlculir option lodil provldei thi losver to 'A^tt objtct'kns 
h thMi flildi of itudy to vhlch it cm be applied. IQ luch fleldii the \ 
oituril pvetlap of required knotfledge ind iklUi froi one educotlonal goal 
or career goal to another le cuvulatlvely very large. Hiire probably vill 
be no einile couree that le found to be leeentlel to every currlculer option, 
yat there probebly will be for eech option et mi e eull handful of coureei 
lAlch eerve that gbel alone. Conetquently the currlculer optlone vlll over* 
lap one anotbtr et different polnte and In varying dtgree, interlocking in 
e Mltldliiniional currlculer epece. 

One cen eeilly reduce thie ebetrectlon to concrete reellty by iioginlng 
e tvo-dlMnilonil letrlx or teble. Acroee the top of Che teble ere lletcd 
the currlculer optlone, eech option eeelgned to e colun of the utrix. 
Doua the elde of the teble ere Ueted ell the coureee offered In the entire 
currlculw, eech couree eeelgned e rov of the latrix. Nov, If a given 
courea le required for e pertlculer option, put en Y In the box within 
the table uhere the coluao for the option croeeee the rov for the couree. 
If the couree le one of ecverel froi vhlch the etudent In e pertlculer option 
luet chooee, put a fraction in the appropriate box or cellt for exaiplei 
If the couree le one In e llet of five froi vhlch the etudent iuet chooee 
two, enter the fraction 2/5 in the cell. Thie couree-by-optlon letrix 
reveele the Indivlduel coureee vhere eech currlculer option overlepe each 
of the otheri end provldee e reedy leane of calculating degree of overlap 
betveen ei)y two optlone. . 

In'e eenee, when e given diecipline et a particular unlveralty 
adopte e currlculer option approech to organliing ita progranai the 
couree-by-optlon iatrlx conatituCea an operetionel definition of the 
field of etudy et that university. But, eince it neither fully 



V 



eubdlvldee nor cotpletely dellklte the field, vhat kind of definition 
can it poeeibly be? Ihe anever can be found in Vittgenstein's theory 
of deflnltlone. He exa«lnea In depth eeverel tena auch ee "gai^^' 
and "nuiber", concluding that there exiet perfectly valid and uaeful 
concepte vhlch Identify e daea of thinga vhoae leibere have no one 
thing in canon and cannot be unanblguouely subdivided Into e finite 

eet of jubcleaeea. 

\ 

\. 

"Ah^ the reault of tble exailnetlon let ve eee e 
coiplicetad network of eJulUrltlea overlapping and 
crlae^h^eelngi eoMtlMa overell alillarltlee, 
eoietlMe'^iliiUrltlee of detell. . .ee In apinning 
« thread ve^'^let fibre on fibre. And the etrength 
of the thread 4pee not nalde In the feet thet eoM 
one flbrt rune through ite whole length, but in 
the ovetlepping or^eny flbree/ ' 

In thoae acadeilc dieclpUneaNrhoae areee of epeclalltatian 

dlaplay "a coipllcated oatvork of eliiVi^leB overlepplng and 

\^ 

crlee-croeelng" end whoee content doee not contain any one fibre 
that "runa through Ita ^ola length", the currWer option approach 
lay veil repreeent the natural fon of organliatloiiv In aitch a 
case, the organiietion of tiia diecipline In the univerdty lay correepond 
to ite organlfation in the vorld. r 

It vill be epperanc, however, that the currlculer option approach 
calla for a mxt eophiaticeted approach b echeduling and diatribullon 
of feculty talenCa than le ordlnerily requited. Since loet coureee 
win play a rola in two or More currlculer optlone, each lust be 
scheduled eo ae to fit into the proper aequence of not \m one prograi 
but eeverel. Ihe key to this probUi llee in deteralning how lany 
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iictioni ot each courie luit b« offered during the courie of a year. 
Thla In turn, depende on laxliui lectloo ilie, coupled with the total 
anticipated annual enirollient In the couraa. 

To find antldpaUd annual anrollMnt ona auat eatliati the 
niflier of atudenta vho will enter each currlcular option each year. 
If all prograM are likely to be ovecaubacrlbed (aa vould be the caae 
currently la Buatneaa) one aliply naeda to aet a cap on the nunber of 
atudenta accepted Into each option) thla laxlnm then becoiee the 
entldpated anroUieat. If eoiethlng leee then full capedty le 
anticipated, aoie' reellatlc Mchanlai Mt be uaed to eetfiate the 
ou^er of etudente entering each option during the year. In the caae 
of a laater'e degree currlcular option requiring one year to coiplete, 
thle ouiri)er of entering etudente a(|ua}e the nuiber of enroUiente required 
by that option la each of ita required coureee. In the ceee of eny 
couraa that le one of eeverel froi which the etudent mat chooea, 
the hudber of entldpated enrollienta froM that option vlU be a 
fraction of the nmber of entering etudente. 

If ve Dov return to the couree-by-optlon aatrlx ve aee that It can 
be ueed to calculate the nunber of entldpeted enrDlliente In each 
course acroae the entire currlcului. If in option with anticipated 
enrollient of 23 etudente requlrei Couree A. then we find an "f 
oppoelte Courie A under that option. If enother option with anticipated 
enrollient of 20 etudente Ueta Couree A aa one couree In a group of 
four f roi which the etudent miat chooae one^ then ve Bight anticipate 
that 1/4 of the etudente Id thle aecond option will enroll for that 
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( Mil \ aeatlng an additional dei&and for five snrollnenta. Suppoae 
lliat we 8UB acroaa all of the currlcular optlone for which the couree 
la required or partlelly-requlted and find an anticipated demand for 
enroUnente. If the laxliui eectlon ilte la 23, then ve know that 
thla couree luat be offered twice during the year and probably will 
have eeverel vacant aeate available for "eervlce'* cnroUoenta fro* 
other departventa or for ujori who take the couree on an elective baala. 

Hie couree4][-optlon Matrix can aleo be uaed to calculate the 
Marginal coat of each currlcular option, defined aa the coat of adding 
thle option If all other optlone were already In place. Suppose 
that we concentrate for the Moient on juat one eleient of Marginal coet, 
faculty effort. Aa we exailna the natrlx we say dlecover that aoioe 
coureee are required or pertlelly-recjufted for only one currlcular 
option. The coat of etefflng that couree then becouea a Marginal 
coat of that option. SUllatly, If in additional aectlon of a ccuts^ 
Muat be offered to lerve the neede of etudente In a particular option, 
the coet of that aectlon la e Marginal coet of the option. If we convert 
each couree and eectlon to an epproprlete percentage of annual FTE 
faculty effort^ and lufl tboae figuree for e currlcular i)ptlon, we have 
calculated the Marginal coat in faculty m for offering that option. 

Marginal coet calculatlona can lead to eurprlilng reaulte. If 
a prograM etande alone, eo that atudenta can take coureea In that prograi 
and no other, Ite Marginal coeti aoar, On the other hand, In a prograM 
that lende Itaelf to organliation by currlcular optlone, the Marginal 
coate of each option tend to be very low. In our case, the wat coatly 
of our options caia to leae than hO FTE faculty, and the cost of 
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idding certain m optioDi ictually proved to be xtro. !he latter 
occuri when all the couriea required by the new option are already 
being taught (or varioua other optlona vith i nunber of unfilled a^iata 
aviilibla in the acheduled aectlona adequate to cover the anticipated 
annual anrolleea Id the new option. 

The nerglnil coat flgurea alao provide i bandy v^ena (or 
avaluatioi the coat-e((ectiveneaa of trh curciculer option^ for the 
larger the laarginel coat, the greater ahould ^.a our expectation of 
productivity. Of coutae, productivity lay ba Maaured In i nuvber 
of dlienaiona, but uaually e currlculer option vitb e very high largtol 
coat ahould be expected to graduate e reletlvaly large piwbar of 
itudaote imtuelly, If not, then it ahould dewnattate aoie atrlking 
idvantage, nuch aa great public aervlce, high national vlaiblllty or 
unuauil potential for generating external funda, Mhen the ritlo of 
larglul conta to productivity becoiee uutcceptably blgh one lUJt 
cooteiplete a redietrlbutioo of faculty raaourcea. 

One of the firat barrlara to conaldetlng i currlctiler option 
ipproich ii tha problei of governance. Louie dictatee thet each 
curriculer cption ahould be controlled by thoae faculty vho identify 
vith it end teach a algnificant nuifaer of couraes in tl; yet eound 
adilniatratlve procedure requirea that reaourca didaiona be iMile 
at tlie depBitiental, school or college level. It la not at firat 
obviouB how both nteda can be aerved. Thla eonfllcr la eracarbated 
by a lecond factor, the eaae vith vhich a nev currlcular option can be 
developed, taialng the apectre of nevcentereof pover and nev denanda 
(or riaourcea. It la not InltlBlly elect hov theae can ha dealt with 
In e fraievork of liilted teaeurcea. Hoat ^Ignif leant of all, the nove 
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tQ currlcular optlona will inevitably reviae the exlating departmental 
conacnaua and elicit aubtle reallgnaenta In the exlating power etructure. 
Kany will feel that they hava lore to lose than they could gain through 
the adoption of currlcular optlona. 

Aaauiing a alnliui level of good faith on the part of both faculty 
and adalniatratlon, theae governance laauea are aaaily (though not 
neceaaarlly quickly) reaolved, but it doea require departure fron 
Bose tiie-honored practlceai To begin vith, the departnent-ae-a-vhole 
Buat aurrender ita abaoluta control over the aialler detaila of cdrrlcular 
planning, leaving theae to the Individual currlcular option comitteca, 

retaining budgetary control end parhapa very broad veto povera at the 

I 

departsental leval/ Since jany feculty viU rbalr a currlcular option 
comlttee and vat viU aarvi on eeveral of then, the actual governance 
situation vlll be aiiller to Interlocking corporate directoratea. 
Ihia guaranteee coMikation between .related optlona, provldea each 
individual (acuity Miber e broad ranga o( Influence, and preventi ^ 
egreglouB opportuniai on tha part of any option, while leaving eacii 
currlcular option conlttee free to exarclae ite beat JudgiDent regarding 
developnent and lipleoenution of Ita prograi. 

The governance lechaniai ahould provide a atraightforvard and 
ayatenatlc procedure for bringing a nev currlcular option connittee Into 
exlatence, ao that the prograi can respond tinely to changing priorities 
and eaierglng concema. Thla alao aervee to offset feare of thone faculty 
vho feel they have Mich to loee through reorganlxation. It quickly 
becoBBB apparent that their ahare of the coaproilae under the old 
allgnnent can be exchanged. for a note rewarding aaslgnnent and identification 



uadtr the new. Since the cutrlcuUr option appioich H not carried 
out vltUn tht conflnei ot i wro-iui gw, wetyone c»n gain alml- 
tanenual;, and In ttna that are uniquely and Individually aatlafylng. 

For thuie dladpllnea i»hich lend theicalvea to organliatlon by 
currleular option, It provldea a nuaber ol dlatlnct advantagea. 
(1) It Mxlidtea utlUtatlon of reaoutcea within the prograa. (2) 
It allowa a relatively aiall faculty to proidde a dlveraifled progras. 
(3) It provldea clearcut guldalinea for interfacing with other progriM 
and utlllilng univeraltyvide reaoutcea. W It allowa a prograi to 
deteriine with e high degree of apeclficlty ji*t what educational 
toali it win euppatt. (5) It penita the Itudent to aelect a 
detailed pfcgtai baaed on Individual career goala and thua iliplifiee 
advlaeient. (6) It piovldei a raallatic baaia for fiwlty aialgnienta 
and courae leiuendng. (7) It aeta up a aUple laana of mdifylng 

augaentlng the progra. aa often aa deaired without >aaaive teorgini- 
latlona. (6) It provldea for a new type of governance which placea mat 
prograi controla at the level while retaining necaaaary 

budgetary ccntrol, centrally. 
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L Th« Need 

Rov can health care delivery be laproved? ThU question la a fundmntal 

0Q« to all periODnal Involved In the delivery ayitei including persons responsible 

for delivering lervlcei and persona responsible for providing the iianpower to the 

ajatei. Although (he prloclpla that health care la a tight la freely articulated, 

the allent reality la that health care la ■ore often a function of geographical 

raaldanca and ethnic origins.* Geographical distribution of health care personnel 

has bean and la being addressed vlth som success through a nunber of federsl 

ptograai, Including the Area Health Education Centera and the National Service 

Core. However, the health care atatus of disadvantaged populatlona, particularly 

black contlnuea to be a probles aa evidenced by iorbldlty and wrtallty rates In 
2 

both rural and urban settings. 

Kontradltlonsl isthods of delivery of health care have made soie 
iipace. A curaory analysis Indlcatea that a wjor deficit In the syatei Is the 
raatilt of a lack of health profeaalonala who are ilnorltlea and willing to practice 
In undersened areas. Where are these practltlonera going to be educated? In 
the early 'aeventlea a concerted national effort waa eatabllahed to Increaae the 
nuibat of black health professionals, psrtlculatly physicians and dentlsta. Thla 
effort did produce results aa evidenced by the nmbsr of enrollees and graduatea 
m achoola of ledkine and dentlatry. Unfortunately, thla effort haa been curtailed 
and adalsslon figures are beginning and expected In the coning decade to return 
to thoae of the ehtles.* A side effect of the Carter policy toward health 
•anpowet education (Budget, 1980) Is expected to be a further reduction In black 
adnlasiona to programs designed to produce health profeaslonals, 

For a number of historical reasons, nedldna and dentlftry(followed 
closely by nursing) receive the aost attention when the words "health profeaalonala" 



are used, tlowever, the health profeaslons include note than 200 occupational 
titles ranging froo the aide level to Fh.D.^a working in clinical laboratories.' 
The tens, Allied Health, la often used to identify the array of persona who require 
registration, licensure, or certification to practice including such disciplines 
as Mdical technology, phyalcal and occupational therapy, clinical dietetics, 
dental hygiene, respiratory therapy» and radiologic technology. Theae professions 
although accounting for 20 to 25 tiaes the nuaber of physicians and dentiats, are 
often overlooked aa a key coaponent of any health care delivery syatev. 

If health care for blscks and dissdvantaged is going to iaprovsi 
it will take allied health professionals ftoa those backgrounds in order to provide 
services.' Qowever, there is a "Catch 22 Cycle" in the aystea of oanpower training 
for the following reaaons: 

(1) Curricula in the allied health profeaaions are highly coa- 
petltlve, precluding atudents who slther have not taken an acadeaic prograa In 
high achool and/or atudenta who have not been succesaful in negotiating the pre*- 
professlonal currlculua (natural and basic ledical science courses), 

(2) Allied health curricula have been designed to m< f tag 
needs and stylea of acadealcally superior and soclo-econoalcally advantaged atu- 
dents; 

(]) Hlnority atudenta have few encounters with black health pro- 
fessionals in the systen and therefore, have few role siodels, Thua, few black 
studenta apply, fewer are accepted, and still fewer graduate. This cycle (pre- 
cluding entry of black atudenta into the professions is reinforce. Uhere can the 
cycle be broken; how can the cycle be broken? 

Since (acuity In educational progrsns retain the declilon taking 
authority for entry, retention, currlculun design and evaluation In the educetlonil 
ayitci, the point of faculty preparation requires change. In other words, the 
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eycla vlU not be broken until then ira wfdcteDt nuiberi of qualified black health 
profaiaionala to Join facultiea of educational prograia. RecrultMnti retention, 
role MdallDg, an4 currlculia dealgn depend upon faculty uho are aeniltive and In- 
tellectaally reaoufceful In thia dllewa. The College of Allied Health Sciencee 
of Howard Univeraity la an Ideal aettlng In which to addreaa thla dilenu and break 
the cycle, 

) IL THE HISSIOK: 

Every graduate prograi which haa been developed haa been conceived 
in aoM philoaopblcal vosb. One tbeia which cbarictiriatically ia found In 
auch philoaophicAl atateienti ia aoie reference aapiring to achieving a 
atandard of excellence.'^ The piety of theae referencea can usually be reduced 
to their lowest coipon denotlnatori i.e., rhetoric. 

According to John E. Halre who recently addressed the snnual leetlng 
of the Aaaociation of Awrican Collegea, ^'excellence ia not a vague, arbitrary, 
pie-ln-the-sky illuaion. It can and doea hava waning when it referencea our 
achieveMnt of soie goal which we have the guta to atate.'' 

Howard Oniveraity ia likeviae "coidtted to excellence in the pursuit 
of ita baalc aim and purposes. Anong the University's alia ia (1) "to help 
develop aolutiona to huun and aocial probleia, particularly those of the 
under-aerved poor and Black coinunitiee." and (2) "to provide educational 
oppoftunitiea for atudenta who nay not otherwise scquite an education of the 
type offered at the Univeraity."' |^ 

Theae two aina can have special significance for breaking the cycle 
deacrlbed In aection one. Firat, while the Judicial and legal procesaea vithin 
our country have aince 1954 atruck down the denial of freedoi of accesa to 
inatitutiona of higher educ/ation on purely racial grounde^ the de facto reality 
la that lliita have been iaposed on Blacka and other diaadvantaged pereoaa 
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bssed on conditiona of econodc and educational deprivation.' Second, recognition 
of the flforeientloned realltlea in higher education atrongly argues for a closer 
exaiinstlon of the Issues (and a aubsequent raising of queatlons) which are being 
addreaeed at thia conference including: 

(1) Standsrda of quality 

Can higher education lake significant iipact on the aocial and 
huian probleaa, e.g«i health care for the poor^ without a greater degree of their 
Involveient in the educational and delivery processes? In ottier wordSi can 
we have X's in the output without having X'a In our inputa and throughputs? 

(2) The Value and future of Maater'a ^ 

Can Maater'a progray provide the catalyst for establishing a new , 

f 

consenaua, including persona froii econoalcally and educationally deprived 
clrcuostancea^that will target and atate up front the goal of inproving the health 
care of the diaadvantaged? 

(3) The Design of Haater'a j 

Can we deaigo Haater'a Prograis that reflect in phllaaophy, content, 
process and outcoM.a conatituency and target goala of thia new consensus? 

The renainder of thia pape^ ahall addreaa these laaues and queationa % 
by highlighting the curricului dealgn of the Haater'a Prograa in Allied Health 
at Howard Univeraity. 

III. THE PROCRAMj 

Graduate education prograas ariee fron cowitaent to a eet of principles. 
These principles are the interface between the content of a body of knowledge 
and the application i^f that body of knowledge. In other words, principlea are 
derived froa an Integration of theoretical principlea and ptagaatic appllcatlona. ' 
•In aoae diaciplinea :he eaphaala la largely on theory, while othera eaphasiie 
the practical appUcatWm of theoretical concepta. In the health ptofeaaloni, 
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tin driutic die io tha utlUiation ind sophiitication of health care places a 

daiand on graduacc prograia to rupond to tha ncedit both theoretical and pragnatlct 

of a changing ayatai. The ilaalon btateMOt of the College of Allied Health 

Sciancaa addraaaaa this laiua; 

Curricuin davtlopust viU be directed tovard ahaplog 
offeriaga to latch tha econoalCi political and aocio- 
cultural facta of contenporary evparienca In order to 
lake eartaio tha changing lodea of thought and iipreBBioQ» 
ai vail ii the changing valuaa that accoipany thei, aerve 
aa tha Mtrix for Initruction la the fundaiental diaciplinea 
vhich uodarpln tha educatiooai atructura of the allied health 
profaaaiotti. 

For tha pmpoaad laatara prograi In tha Allied Health Sciencea, the applicatioa 
of thia ilaalon atatevnt tranalatea into a Duabar of baaic aBainptiona about 
tbi dtaip of tha prograi. Although tbeae aaamptiona range froi the general 
to the apacific, they are characteiHied by interdependence; they are of equal 
'liportanca. 

1. Th e ovtrall jtoal of paduata education ia to add both depth and 
breadth to tha atudent'a acadeelc preparation end life experience . Studente 
puraulog thii gnduata prograi viU utlllia the baaic Inel of education and 
axparlanca of iMx apecialty area aa a atepatone not only to greater depth 
of theoretical eppliad aklUa of their diaclpllna, but a broader view 

of the health cata context to vhlch their apecialty relatea.''^ 

2, Th a knowledge and akill baae of the Bpeciality areaa are those 
iihich ira defined and controlled via a variety of iechaniaM * Undergraduate 
education in the allied health diaciplinea la characterized by hooogeneity 
la curricului deaign, Uhlle each prograi lay eapouae a unique philosophy, 
affact'lflg auch iiittera aa atudent target group and pedagogical lethodBi 

the Bubject latter content ia designed by profeBsional concensus. The 
knovledga and akill baae ia defined both through the prograi accreditation 
prociaa invilvlng tha profeBaions in coUaboratibn with the apprnpriate 
BgeDClea controlling prograi accreditation and through a nechanisa of 
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practitioner certification and registration by the professional assoclatiaaa/^ 

3, Graduate level education in the allied health professions la character!- 
led by variety in curricului deaisn . In graduate education for the alUeil health 
profesaions, no single curricului has proven aatiafactory to leet the needa for 
the variety of career rolea that the graduate level allied health profeaiional lay 
aaauie, In fact, dlveraity vlthln and acrosB professions is the "nori" for grsduate 
level education for the allied health profeaalona in contrast to the lore hoio- 
geneoua prograia at the undergraduate level, 

k* The dynaalc sroyth of the allied health professions hss resulted 
in B continuing redefinition of the functions in ths vsrious specialty areas .^^ 
As health care hsa becoie ior« apecialiied, the functiona in the allied health 
professioQslB have becne lore predaaly defined vith greater autonoiy and inde- 
pendence. Allied health graduate education<vlll continue to becoie lore refined 
as the body of koovladge and the application , of that knowledge in practice beconea 
Bore dafioBd. Thia progtai vlU create agenta of change to provide infuaion of 
knowledge into the process of th^ ongoing definition^ 

J. There la a need for persons sducsted through the grsduate level 
in specific discipline areaa io particular and in health care in general . The 
increased deisnd for heslth csre end the subsequent increase in use of allied 
health peraonnel haa created a lanpover ahortage In both allied health practice 
and allied health education* Exlating health graduate prograia have helped to 
relieve the isnpower. ahortage in aoie regions of the country and in soie of tha 
vell-estsbllshed disciplines* Tet deiand continues to surpasa supply. Prograia 
ahould respond to individual atudent needs while st the saie tlie uintslnlog 
acadeilc atandarda of excellence. An undergraduate allied health student 
genersUy haa a foundation in the basic sciences together vith discipline related 
theory and skill developient. These are then applied In a variety of superviaed 
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cUalcil lettlngi Id order to p^piri coipetioC pracCltloneTi. Thufl, allied 

\ 

heilth aCudenu entertni the 3raduke prograi represent j population that under- 
iCindi both theory and Ita appUcatl\ln practice. Since the appli- 
cation of theory through vork eipfirlenceVarlea aiong and acroia diaciplinea, each 
iriduitft Milt havi i prograi developed on individual eiperience. Tliefe individual 
wrk eiperieacei uy have broadened their profe^ional coipetency dlaparately, 
Thirifore, each atudent will require upon adiiaaio^a p the graduite progran 
individualiied icadettlc proceaaing. 

6. Tr idltionally black inatitutiona have beeri\the Mat auccenful in 

prepirlpR blick profeBaionala .^* Eiiiting allied health graduate prograia have 

\ 

recruited ilnorlcy itudenta^ including black atudenta. Houev^ the earollnent 
of graduate linority atudenta haa not kept pace vlth the graduatkiarket denand 
n:)T vith the anrollieDt potential created by the undergraduate pool\ Cost, 
geographical locution, and United ainority role aodela are casual fac^ra la- 
pacting on the enrolhent of graduate ainority it-udenta. \ 
B. Ptograi Cbaructeriatlca: v \ 

ThevnUied health aciencea have been charactariced by a period of rapl^ 
grouth and expansion of peraonnel and prograaa. The ensuing period of growth 
vlll likely be ncted for (1) qualitative iaproveaent of exiatlng educational pro- \ 
graaa; (2) ^expanding leaderahip rolea for allied health practitioners in the 
health care setting; and (3) increasing basic and applied research actlvitiea. 
The faculty' and ataff of ^the College of Allied Health Sciences believe that a 
graduate prograa can provide the personnel required to respond to these directions. 
The following five characteriatica delineate the educational concepts for the 
aaater'a prograi in the allied health adenceai 

1. Multi'diaciplinary in Scope 

As health care becoaea aore conplesi it becosea aore speciallied; and 
baalth practitioners vlll vork in settings Increaalngly characterized by inter- 
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dependence of nuaeroua diaclplines. Therefore, the efficacy of the health care 
syatea vi-1 depend upon the sbility of the specialiats to function In a unified 
ainner. Knovledge of the interdependent relattons of sU the peraonnel in 
health care is the first step in developing a concept of the health care tesa. 
That particular concept can beat be nurtured In a aultl-dlaclpllnary aetting. 
Cooperation of diaciplinea auat be aodeled in both the acadeaic and clinical 
education aettinga if collaboration ia to be iapleaented in service areas. The 
graduate prograa vlll provide atudenta an opportunity to focus, identify, explore, 
and respond to the issues and the practices of the variety of allied health pro- 
fesfllona in relationahip to the health care aystea. 

2. Eco_noaic_inj8e of Reaourcee 

Budget restrictions snd continuing llaitations on resources aakes it 
Incressingly iaportsnt that developing prograas not duplicate useful existing 
courses or prograas. Resources in the university cooaunity need to be constantly 
exaalned to ensure the fiscally sound prsctice of sharing existing reaources* 
Hovever, this sharing of resources should not coaproalse the quality of sny new 
or existing educationsl progrsa. Stretching a thin resource vould coaproalse 
quality. Tapping of existing resources aust be done in the context of exaalning 
vhat resources are available and what conatrainta ere upon thea. Concoaltant 
vlth the utiliiation of present resources ia the requircaent to augaent (where 
appropriate) those resources snd to develop nev ones. Therefore, the graduate 
progrsa vlll necessarily extend acroaa college lines; the prograa vlU be both 
Bulti-disclplinary vithin the allied health professions, end intercoUege vithin 
Hovard University. 

3. ' Professional Concentration. Area 

r 

y The third preaiae of the prograa is that students vlll aelect a con- 
cenVation of couraea in the advanced basic and/or allied sciences directly 
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nlitid to tlielt reipectlve undargriduita degree. Thli prenlae hai been both 
foitired bT the hiring practicei of institutioni lod lupported by profeialonal 
iilociationi in thi allied heilth dlflclpllDei. The trend tovord upgroding pro- 
faailonal antry requlreienti ukei It Ixperative that allied health profeailpnala 
cootlQue to npand their knowledge In their choaen dlacipllDe through graduate 
atudy and reaearch. Vhathar the graduate o( a laatar'a degree progra* la going 
to teach baccalaureate level itudeota or aupervlaa baccalaureate level griduatesi 
thera ia a neceaalty for a broader baae and a' deeper undarataading of dlaciplina- 
ralatid conCent than that poaaeaaed by the holder of the baccalaureate degree. 
*. Alllad Health Concentration Area 

Thi goili of the entering atudenta viU vary according to one of Elva 
patternat (1) preparation for advanced clinical practice; (2) preparation (or 
teaching; (3) preparation for uangeaent and auparvlalpn; H) preparation for 
further graduate work or reaearch in the dladpline; and (5) preparation for 
International progru davelopsent, Thereforai the graduate progroi will be re- 
aponalve to Individual naeda conaiatent with good currlcului design. Each 
atudent will deviilop peraonalhed program objectlvea related to pursuit of 
educational growth and be able to aelect one of the five patterns aa a allied 
health concentration area« 

5. letjuire Profeaelonal Experience for Adaission 
The fifth and final praise ia the conitunC to adalt only qualified 
and experienced iillied health profeaalonals. The prerequisites for adiiaalon 
ire a baccaliurente degree In an allied health profeaslon with appropriate re- 
|tBtration» Uceraurei or certification. Additionally, each student will be 
required to hive a iiniPhii of two yeare of clinical or equivalent experience. 



CONCLUSIOH i 

John H. Gardneri. in Excellence , a book of the aixtlea relevant for the 
SQventles and lost likely the elghtiaa, aaya that "hunan aocletiea have severly and 
aucceaafuUy United the realhatlon of Individual pronlse.'* Vc do not aubnlt 
that the taater'a prograi (or allied health profeiaiona ac Howard Unlveralty will undo 

past history nor drakatically change the future for the whole of the health cara 
dellvtcy syitui Vi do bellivi that U vlll help Indlvldualg itillie thtlt prMlie. 
The phlloBoph; of the progru hii Iti rooti In the CoUege Hlaalon, one o( changlAl ' 
vsluei and redefining the atandardi of quality and the meaning of icadenlc quality. 
These value changea and redefinition. In the ay.tei begin, not end, vlth people a. 
patient, for a. ve deal on a day-to day biola vlth atudenta uho are also allied 
health profeailonali, hov ve function in their vorld oayi dearly what ve believe 
about ouri. 
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Tho Viiluu of Omdiiatu Progrtttnti; Thu UUUT Umlul 

Dr. JaiDos L. Reloli 
California State Unlvoralty Domlnguoz llllla 



Thii Value o( Uraduate Programs; The ysUT Uodul 

Dr. James L. Volcb 
California State University DoiMnpcz Hills 



The academic arena of higher education In which we find ourselves 
today, with regard especially to graduate, professional education, 
there prevails pressures dictated by professional societies, or- 
ganizations and governmental bodies coupled with technical ad- 
vances In the pure and applied sciences. These developmente have 
produced an array or responses Involving, at least In part, pro- 
liferation of roasters degree programs, A current very popular 
node of delivery has been external degree programs. These pro- 
grams typically are directed toward the new learner: the adult 
population. 

External decree programs, being offered at site locations avay 
from the main campus, present many unique problems of concern to 
the educator and consumer alike. The quality of these programs 
as it relates to students, curriculum, faculty, library and audio 
visual facilities, in general, program viability, all must be 
given special attention. The following Process and Outcome Ob'- 
Jectlves as part of the Master of Science In Medical Technology 
External Degree Program at California State University Domlnguez 
Hills, address the Issue of an evaluation mechanism used to de- 
termine quality In these areas, 
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PROCESS QDJECTIVE 1 

The recruitment of qualified appUoants to the UBUT Program 
lUl be undertaken through communication channels appropriate to 
the profession of Medical technology. 

DATA: 

1. A listing of professional publications and the 
corresponding date in which the announcenient 
appeared. 

2. A description of mailing lists employed and the 
date of the nailing. 

CRITERIA: 

This objective wlU be considered as met If 
1. Announcements of the HSUT program appear In such 
publications as: 

a. Journal of American Medical Technologists 

b. Lab lor Id 

c. California Association tor Medical Laboratory 
Technologists Newsletter 

d. American Association of Bloanalysts Bulletin 
RESPONSIBILllY: 

It will be the responsibility of the Director USHT 
Program, to prepare and submit appropriate press Infor- 
mation designed for the specific publications listed 
above and to send brochures to those on such mailing 
lists. Records of announcements, mailings, and public- 
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tty aliill bo Hulinlttml to tliii Kvitliiitlor. 
PROCKHH OIUtCTIVK 2 

Appliointii iiliiiltt«(l to tho mi program will liu In iioiniuuiilon 
of a CiUfornli lICBiiue m « CnlllnrnU Ulinrfttory T«cli5olo|[lBt or 
ba » mgiiiterBd Uodioil Toolinolonlut with tliu AmorlflHi flooloty of 
CllnlQil PithologlBts, h»vu profoaHlonil oxporlanou boyond tlin 
Initial trilneo period, und havo a baoholorB douroe or equivalent. 

DATA: 

1, Application forma which will verify either California 
licensing or registration with the American Society 
of Clinical PathologlatB. 

2. Application forma which will include at leaet one 
letter of ncomnendatlon from a current Bupervlaor 
or a prevlouB employer verifying that the applicant 
has profeaslonal experience beyond the Initial train- 
ee period. 

a. Official college transcripts of previous college or 
unlveralty work. 
CRITERIA: 

1. This objective will be considered as met If all ad- 
mitted applicants 

a. are Ucanaed or reglatered medical technologlats, 

b. have professional experience beyond the initial 
trainee period, and 

c. have a bachelor's degree or meet the equivalent 
requirements of Executive Order 168. 

RESPONSIBILITY: 

It will be the reBponslblllty of the Program Director 
to evaluate all applicants with respect to the estab- 
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lliiliiiil tirlliirloii und to nnrlUy IhHl all adinlllnd iiHidtuitu 

niuut tile tiHlulilUhed iirllorla, 
I' llOdKBS flIIJECTlVK II 

All HtudonlH advanced to full oandldiioy for iJiii HHHT degrtifl 
HliiiU havo a mliilw Ki'ado point aviirago nf a, (in and nhnll hiivu 
complutud at leant 24 nuartor unlla of ajiprovuil nounio work. ^ 

DATA: 

1, Applications filed by atudontu tnr iiilviuicomonl to 
full candidacy. 

2, Orade point averages of students advanced to full 
candidacy. 

3, Liat of approved courses completed by each atudont 
advanced to candidacy. 

CRITERIA: 

This objective will be conaidered as met If all students 
advanced to full candidacy have a minimum grade point 
average of 3.00 and have completed at least 24 quarter 
units of approved course work. 
RESPONSIBILITY: 

It is the responsibility of the Office of Admlsalone 
md Recordfl to compile grade point averages and Hats 
of courses completed at the end of each quarter for 
all admitted students. These will be transmitted to 
the Evaluator and the Director. The Director will 
notify students qualified for application for full 
candidacy to fill applications and will provide appli- 
cation forma. It la the responsibility of the Evalu- 
ator to review records for compliance with criteria. 
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All pirl-timti mil oft'OiiiniiiiN lm\\ii wlm Um\\ \\\ IJio MdilT 
pravriiiii wilt muet thu rtigiilar m)\m (irltdda lo hi^iiro Iho 
loidflinlo (|iii(IUy ()( Hid iirogmn). 

DATA; 

1, hlHt ()( pKrMImn nnd off-oitnpii tnoiilfcy liiillotttltiu 
toiuhliig aaHlKmiii, 

2. Oortlflohtlon by at \mi two o( tha following tliiil 
pirl-timo Rnil ort-oampue taauUy moet tlio roKiiUr 
campuB crlturla for the hiring of InutruotorH. 

&. Director of tho HSMT Prograin 
bi Dein of the appropriate School 
0. appropriate departDient ohalrpareon 
CRITERIA; 

- Tills objective will be considered as net If the required 
certification 1b on flla attesting to the comparability 
of the tivo types of faculty, 
RESPONSlBILin: 

It la the reBponslbillty of the Director, HSUT 
Program, the Deans of the participating schools, 
tnd department chairpersons to select faculty 
members through existing channels, In accordance 
with o.vcampus standards. It Is the Director's » 
responsibility to designate permanent faculty 
members on class scheduloN. 

PROCESS OBJECTIVE 13 

Library facilities will be made available to all students in 

the HSHT projram through the use of both on and off-campus resources, 



I. Uiltoi'N of imrnuiikiiil (niiii iiff'UHiipi HbrarlDH 

11 1 lowing m\m In Mtiiilunlii l)i lilt) UllUt itrouriiii). 
1 tliiiilhiil <|iiiiHLliiiiiiiilr<iM rolullhg (.1) iJio uvulUlillliy 
of library mi^iirooN, 
ClinWA; 

Tills objuullvu will 1)0 ciiniildnrod mi mi K \\i \mi 

ono onntraotual agruomunl uxlutN wllh an otf-cunipiiii 

I 

library Allowlnii'toooiiu to tlio (iiollltluu tiy UtiUT 

I 

Students and if the majority (over M] nl thuue atu- 
dents Indloate ojt the questionnaire that oiitelda li- 
brary faollitiesiare available to them* 
IIBSPONSIDlLin: j 

I 

It le the reflpoi|Blbllity of the Director, M81IT program, 
to establish all arrangements and agreements to assure 
the continued availability of reeoiirces outside the 
CSUDII library. It is the rufiponslbllity of the Evalu- 
ator to check whether or not students have access to 
off-campus ll|)rarles. 
PRQCESa OBJECTIVE 15 

An annual report will be prepared and submitted to the Com- 
mission on External Degree Programs at the end of each academic 
year, 

DATA: 

A comprehensive written re'port describing nnd evaluating 
the year's activities and progress with respect to the 
stated process and outcom? objectives. 
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PROCESS OBJKCTIVK 15 continued../ 
CRITERIA: 

Tills objective will be conaldered bb met If an annual 
roport Is published and submitted to the CooinleBlon on 
Exterral Degree Prograns, 

RESPONSIBILITY: 

The Dean of Community Programs and Extended Education, 
the Director I MSUT progran, Administrative Coordinator, 
MSIIT program, and the Evaluator will share the reaponsl- 
bJllty of report preparation, 
PROCESS OBJECTIVE 16 

The U8IIT Progrdffl will be reviewed annually in order to remain 
consistent rlth advances In the field. 

DATA: 

1. Minutes of the annual meeting of the HSMT Advisory 
Boird. 

2. Objectives for each course In the MSIIT Program. 

3. Course outlines for each course in the MSMT Progran. 
CRITERIA: 

This objective will be considered as met 1/ the MSMT' 
Progrira is subjected to an annual review and revised 
18 necessary to be consistent with developments in 
medical technology as recownended by the USMT Advisory 
Board, 
RESPONSIBILITY: 

It Is the responsibility of the core faculty and the 
Director, MSMT Program, to monitor Journals of the 
medical technology field and to hold a review session 
once a year to consider curriculum revision, It is 
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PROCESS OBJECTIVE 16 continued, . . 

the responsibility of the Director to call an annual 
meeting of the MSMT Advisory Board. It is the respon- 
sibility of the course Instructors to revise the course 
outlines and objectives in keeping with MSMT Advisory 
Board recommendations. It is the responsibility of 
the Evaluator to review course outlines and objectives 
for changes in ^keeping with the reconwiendations of the 
MSMT Advisory Bdard. 
OUTCOME OBJECTIVE 1 

Students will demonstrate knowledge of quality control pro- 
cedures in the laboratory by: 

X, 

A. Defining criteria for selection of reagents and equipment 
for^a designated section of the clinical laboratory, 

B. Defining relevant terms, . 

C. Listing steps used in maintaining dally and monthly quality 
control programs, and 

D. Simulating a monthly quality control program from factual 
data. 

DATA: 

1. Behavioral objectives for MDT 404, Quality Assurance in 
the Clinical Laboratory. 

2, List of students meeting parts A through D as provided 
and certified by th^i instructor. 

CRITERIA: 

This objective will bs cs^^nsldered as met if the behavioral 
objectives for MDT 404 are on file and the course instructor 
verifies that: 

1. Eighty-five percent of the enrolled students listed de- 
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OUTCOffi OBJECTIVE 1 continued, . . 

tloed 951 oi the criteria specified in Part A. 

2. Eighty-live percent o( the enrolled students de- 
fined 952 of the terns specified in Part B. 

3. ElgbtHive percent of the enrolled students left 
out no more than one step as specified In Part C, 
and 

4f One hundred percent of the enrolled students ade- 
quately slnulated the required pregran as sped- . 
fled Id Part D. 
IBSP0N8IBILITT: 

It is the responsibility of tbe Director, ilSHT Program, 
to transnit the required course objectives and in- 
structor verification to the Evaluator. 
OUTCOME OBJECTIVE B 

Students electing the Clinical Laboratory Managenenc Option 
fill depionstrate knowledge of computerized methods » medical per- 
soDoel oanagcinent^ ;iiid advanced application of health care delivery. 
DATA: 

1« Behavioral objectives for UDT 410. Health Care De- 
livery II, ifDT 412, Hedical Personnel Uanagement, 
IIDT 414, Advanced 'Data CoUectiDn and Control Tech- 
nology, and MDT 416< Budgeting for Health Care Insti- 
tutions. 

2. Student scores on' criterion. referenced examinations. 
CRITERIA: 

This objective will be considered as met if the behavioral 
objectives for MDT 410, MDT 412, MDT 414, and MDT 416 are 
on file, and the course instructors verify that 851 of the 
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OUTCOME OBJECTIVE S continued,*. 

enrolled students met 85% of the course objectives 
as defined by the criterion referenced examinations. 




RESPONSIBILITY: 

It Is the responsibility of the Director, USUT Program, 
to transmit the required course objectives and student 
scords on the criterion referenced examinations to 
the Evaluator. 
OUTCOME OBJECTIVE 11 

The program will provide upward mobility lor graduates holding 
the MSMT degree. 
DATA: 

Follow-up questionnaires mailed to all graduates two 
years after the granting of the degree to determine 
past and current job title and salary* 
CRITERIA: 

This objective will be considered as met, if, during 
the two years following graduation, at least 25) of 
the graduates experience i promotion and are granted 
at least a 25% imme in salary. 
RESPONSIBILITY: 

.It Is the responsibility of the Evaluator to design 
the questionnaire and to compile data from the re- 
turned questionnaires. It Is the responsibility of 
the Director, MSMT Program, to distribute the ques- 
tionnaires to the graduates and to monitor their 
return. 
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Ji:i EVWiATICN or THE NMiaiAL EVALUATIONS 0? GRAttMB PFOGRNB 

Richard I. Hlller 

Vice President for Eldxatlmal Servias 
State Ihlverslty of llew York at Biockport 

Beglming with the llughefi atuly 1ft 1925, a mmber of natlcnal Btwdiea of the 
quality of graduate atudy \m been nade, with the nwt recent arte ly Udd and 
tlpeet md reportad In the January 15, 1979 Issue of flte Ctonlcle of Higher 
ttotlon « The Anerlcan OawU cn Miraticn IflCE) has taken an active role In 
ratbg yaduate ptograe In major universities, beginning with the Hughes study. 
IhB mt detailed ACE study, by Allan Cartter in 1966, assessed quality of noth 
{jofesslonal graJjate study In major mlTOraities. Five years later, another Affi- 
spcnsord stuly Rooee and Anderscit (1970) rq)Iioated the Cartter study of major 
graijate ptqrara In non-profesalonal areas. Hie Cartter study received usable 
answers froti an qilnioi survey of 900 departnwit chairmen, 1,700 cwtstanding cenlor 
scttilarB and Bcleidsts, and 1,400 younger KadOTlclans. In all, 30 disciplines at 
106 irajor instltuticw vere surveyed cn (1) the quality of the graduate faculty, 
12) the effectiveness o? the doctjoral progran, awl (3| the degree of expected diange 
in tha relative position of departjients offering doctoral study In the discipline 
of the rater. 

lite tooee nwl AirierBon study was essentially a replication of the Cartter 
study, vrtth slight enlargrtient-Beven additional dlsdplinciS and tventy-five a*- 
diticwl insatutidw. It did depart tron the Cartter study in taking a mich Icwer 
profile in :^tt,rti the data; "In i^xiatlng the ratings of graduate programs, v« 
[Itoose and Airieraon] have had serious misqivlngs abait the apparoit endorscnent a 
study of tills kind gives lo the prliwcy of a... hierarchy of iniversity prestige and 
. influffK». For tills reason, we liave sought to play dwi the actual scores and ad- 
jecUval descriptions of faculty ard progran quality, preferring instead to dutolze 
ttte ijniortincQ of identifyii^ faculties anci programs with scores at or above the 
2.0' floor set flw y^ars ago/ (p. 24). It is likely that tJte national student 
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inrest at the tine plus student and faculty agitatlcn for more oiphasls ai uidir- 
graduate teaching were Instninental in this decision. 

Ihree other studies are related to the 1966 C^ter work: Ilargulies and Blau 
(1973), Blau and Marguliea 11974-1975), and Cartter (1977). Ihe first report hy 
Mai^lles and Blau used the critericn "that has been ftxa^d to be nost reliable,* 
whld) was the judpent o? experts in the field*-in this case, deans. This report 
asked 1,180 deans of seventeen different subject areas in professional schools to nane 
the five nest outstanding schools In tlieir profession but ret to rank than. IBie 
earlier Cartter and the Boose and Anderson stulies did not Include professional areas.) 

As one vould expect, the first liargulles and Blau study was discussed widely; 
arKi the seootd study one year later (Blau and liargulles this tine) dealt with critlciai 

a 

of the first report: 

Che groif of critics categorically qppose ranking schools. Such rankings, they think, 
engender invidious ooBwriscns and hurt many good schools that may not be at the very 
top in their field, pwtlcularly in a period when it is difficult to obtain nudh ' 
needed financial resources. But this view sees the results of such rankings only 
f rem tte stai^lnt of sdxok and their adnlnistrators and not f ton the perspectivB 
of their publlcsi especially prospective students and erployees, who have a. stake In 
knowing how schools coupwe In quidlty and reputation. A seoad aiticlan of our wrk 
was that it did not furnish infonnaticn cn the quality of professional schools, slnoa ' 
the rankings were based on the jixJ^nent of deans and not ai objective measures of 
quality. As one critic put it, 'These are just tha (pinions of a bunch of deans.' A 
third major critician of our study was that tha rankings of at least some types of 
schools were based on very few responses, those of only a anall proportion of all 
(bans in a field. Ihis criticiait is \^11 founded." (p. 42), 

Bte replicated study by Blau and liargulice oo-related closely witli the one that 

they hal finished a year earlier; "The correlation in the new and the old Btdy 

betfcfien reputation ratings for all schools, not only in the tx)p five, in all types of 

professions is .94.... If separate correlations for each type botv^ the new and the 

old reputation ratings are ccrpitfid, thirteen of seventeen are larger than .90 and 

none is lower than .75." (p. 43). »ille these correlations span only one year, 

Ckrk has coipared ratings over tiro, beginninj with the 1925 ll#es study, and foind 

"university reputatlois are exceedingly stable. All of the top twenty univeraiUes in 

the earlier surveys are still at tha top, aid relatively few new ones have been 

added." (p-89|. 

Ihe 1977 Cartter stidy on education, law, ard busiress started with different 
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roferenta— faculty mentxsrs, and ainoe tlie imi^vrse was fifty-one Ph«D, granting 
inatitutiona tha profeaaora amt] bo €0<poctxxi to bo researcl>-oricnted. He results 
of the Cartter study, with Blau-tHrgiilics rankings, arc given on the next \^cje, 

Carrelaticns br jwoen the Blau-tlargulies and Cartter sbxiiea are quite hiyh for 
the first five or six places altliough sane striking differences do exist, lliese dif- 
ferences may be due primarily to the different ways in which the data were collected 
or in the clienteles s^nn^^lod. Cartter supports his thesis in this nvmner: "IJhose 
jud^ncnt does one trust: 146 deans asked to name cnly 5 sdxxDls, or 453 professors 
and deana drawn fran all 51 doctoral-granting institutions? The most knowledgeable 
teachers/acholara in the field, in our view, are niich more in tune with the quality of 
acholarship and e:3ucaticn in otlier institutions than are sclclarsliip and oiication in 
other institutions than are a few faculty stars and deana who may be more faniliar 
with the aanlnifttratlon." (pp. 42-53) Blau and Morgulies (1974-1975) would dis- 
agrees "Ttie central poeition of deans and their responsibility for recniibremt should 
make them particularly well informed about the quality of the schoc^ls in their field. 
It) be sure, the resulting ratings of school reputations cire merely the opinions of 
these experts, but all profeaslonal reputations are no more than the opinions of follow 
experts." (p. 42). It la Intereating to note that Cartter's 1966 atudy used statis- 
tical procedures to determine the differences in ratings ancng departinait chairman, 
aenior ach^Iaf^vmd junior scholars. He found that "...there is little to distinguish 
the ratings of tha chaicmen or of tie junior scholars frrm those of tlie senior 
echolara.** (p. 7). 

Hie inflixaice of sheer size has been mentionod as a crillclsni; namely, bigger 
la vievjed as bctb>r. (Wlsp^ reached this conclusion in studying the size of psycho- 
logy departments »jscd by Cartter.) lliose institutions and departir^ts with the 
laziest nurters of graduates do tend to be the top-rated institutions, le^lng to 
the generalizaticii that ratings likely do favor larger units since they produce nore 
graduates who in turn retain saro nostalgia for "those days in graduate sdiool." 
Mao, tlie larger iinits are more visible in the professional literature, in writing 
ai«3 consulting, at ornvcntiona, aiul in ntrixjrs of graduates, therefore visibility 
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latirf with petoelval quality. Of course the lai-:;er departinenta nay be 
:ue of the aivantflges of diversity, specialization andaoUeglalltyancnq 
)ro''es8or8. 

;pc-ik9 tb the qusllty Issue In tenia of sUe and type of Institution: 
\ analogy to sports, the pboe of the lihcral arta oollega ia, in 
)e lush leaqvie little leiigue, altlough sate of the best kncwn and 
xis (such as Swartlrore or Antloch) might be considered sufficiently 
^ican higher ediKaticn to be accorded niinor league standing by faculty 
>lhges couIJ ever be consicfered »-<]or league. Lackijig graduate and 
Eaailtiea and aturitfits, their InfJivcTjoe on higher educaUon is slrply 
(ip. 154-155). 

Mtit cn "to orarpare or not to ccr^e' goes on. The acadanlc ocnrnnity 
Men ooTparatlve ratings, for two reascns: only a fuw can bo anointed 
ighly) yet those In acadaic know that outstanding invldiduals and inits 
re as well, ftrxi the technical procedures for makijig the ratljiga are 
il mid no ore can be sure about how nuch credulence to plaoe in the 
study by Pees, stlnulatiBd by the tw ACE studies in 1964 and 1969, 
mir. dct^artr^^tiJ using a greater niiPber of qinllty indices than wiis the 
ftfl stuiy. "Rje results Imllcated that the only significant difference 
1^1 anJ low depiirUiwits was in ecp satisfaction. These findings caused 
r in view "with consirfcrahle caution" the findings of the T. studies. 

M, ]fy;islat.f>rf}, ar»l other pu)>lir nfficbla generally favor ratimjD, ard 
an! o^islKtr-nt with aiirmt «si)||<i.im>H oriirurvr I • m. usfi of 
iLil ty r.itlt»j:j will {xjnHium to Mi^.e nirloMity, aitnig**, or eunxirt 
,1 IxMl'liy iV^jhM' of pVopt icifzn mlglit well cvor^my wln»pvrr poaiLion 
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lo'd TO mm quuiTT in habiii's prociahs 
k m m mm hat 

Divld S. Uibitlr 
Unlviriltf of CiUfotnli 4t lot Antllti 

Thi biit-kiCHB itvdlii o{ thi quiUty of [ciilulti pro|riii 
vlrtuiUj lU riti thi quillty of Ph.D, ptoitiibt thiii itudlit 
Uu iiviri tbortcoiliii, tvin ii iitln|i of doctortl prosrisi, 
ind vbiB tieknlquii in divilopld for ritloi ilitit'i dlirti pro- 
init, thij vlll ai(d to bi virj dltfltdAt ftoa thi lithodi vldUy 
qiid aoH. Ut'i look, btliflj, It tbtii tmkntii uidd tichnlfttU 
of iiiiiilhi tbi quiUtj of iriduttl pro|rti(. 

1, Om iitbod, ptopoiid by dotbtDpologltt livtrllj Hutl- 
birt (Oi uiii t"liio|i thidtj In titlfll iothropoloij diMt^iin^'* ' 
VhiD dipirtiinti hlrl iicb otbl^'t fh.O.'d, ib« ittviii that ttily . 
irt iquil In ititui, but It, tor haipiii th6 Univlriity of rior- 
Idi blrii iiviril of Bovitd'i H.O.'ti lod ttirvitd doii not ridp- 
rociti, ibi cotcludii thit tiimi U bl|bbr In it(tut| thuti by 
iiiilnloi riciiit hiring pittirni Hong ualvlriltlii, ihi rink 
ordiri intbropology dipirtiigti. Ibli Mtbod hii atrlou tlivi, 
Ittdvdlsg thi folht'lngt 

1, It ctn Kiiuri only tbi ttrinfth of dipitiiinti roUtlyt 
to ii«h otbir, not thi quillty of iich dlpirtiint. 

b, It iiiuili tbit unlvirilty hiring pricticii in intlclly 
iirltocritlc. 

c, It liiium I dipirtiint'i itr(.,gth by only thoii gndu- 
It <^ -ilv .tppolntiinti In Ph.O.-gti'.itlng Initlttitloni. An 



t'coHoiici dipirtiint, for ixiipli, thit producid 20 Ph.D. 'a, of 
Vho tvo bicifli iiilstiQt profiiiora of iconoilci it Fh.D.^iinntliig 
uolvinltlM iDd 16 biciii hoboiii vould bi ritid hlghtr thin i 
diplrtaint thit turoid out 20 Fh.D.ig ill of vho viri hind for 
riipoDiibli Jobi by iijor corporitloni ind govirniaiiit it!«nciii. 

d, it ntli dipirtaiDti lolily by thi firit joba of thilr 
gridultlii lod tiiui ittrlbutii too mch iBportinci to thi quillty 
of i progr'^i'i itudinti* Hinj itudlii by Alixiodir V« Aitla (iii} 
for ixiipUt 11 hd othiti hivi ihovo thit thi icidiolc ichlivi- . 
Utit of colUgi Miiioriji lueh ion influiocid by thi ibllity of 
thi itu^toti vbid tbiy lnt«rid thto by th^ Inicltutlon^t "quillty," 
ki If iUt fliidlDl holdi troi fot griduitl iducitlDfl, ind If 
thi lilt itudinti git thi but lobi, thio thi "uchangi" iithod 
Uilly aititirii thi quUity of I progra'i itudintaj oti than tb« 
ijuiUty of thi progrii. 

2, Anothir iitbod of ritlng thi quillty of griduiti pro- 
grias hli biiD liployld by Jick Couriin (3)t ind vhlli Hurlbirt'i 
ticbnlqul titii ptogriii lir|6ly on oni fictor - the quillty of 
thilr itudinti Gouriin goii? to thi oppoalu ixtrini and cooildiri 
1 gnat nuablr of thlngi. In hli ''Hithod of Eviluatlon" aictlon 
hi Biyi hi bii ivikitid iich Initltutlon'o "luiplcia, contvol ind 
orginiiitlon," its ^otil iducitlon progrini offirid/^ Iti "nuiibir 
of non'dipirtiinNl iriiii" igig idBliiloni riqulrmintii itudint 
inroUiintg tiachlng otiff, phyilcil ticiUtlii, flninciig currl* 
cuius ind riiiirch. 

iut Gournin glvii acarcily i clui to hov ht m^mi all 
thiBi thlngig BCircily i dui to hov Important hi coii»l(i)rid m\\ 



of tbil (bov, for iiiiplii do jou vtlght i ichoora "tlichlng 
ititf" i|AlQit Iti "il doll I schoDl |iln or loii polnti 
biciuii It li oldt Alio, vhio GournD iiiiiiii I colli|i*i "lui* 
plcii, control md oriiiiUitlon," vhit typii of iuiplcii lod or- 
liQliitloD liiprovi oni'i rithgi lod vhit typii hurt Itt GouriiD 
li itliAt 00 thill. lad liny othir i^tbodologlcil iittiri. 

iit my iriti, Couriin ittiipti do ritlngl of induitt ichooli 
by fiild) iicipt for liv, iidlclni, iod dlntlitryi Oni oorilUy 
intifi i.|ri(luiti proirii to itudy i pirtlcuhr lubjict - Ivln^ 
11 ooi'i proKras li Intirdiiclplioiry, it li itUl oorUUy biild 
cn I fo rilitid flildi - ind Oouriia'i |lobil rltlo|i ot Oahir- 
littrj iiU Uttla, ixcipt (or thi (llldi of tUkitk^ hi 
JiiUlitryi aboult any pirtlculir (lild of itudy. 

3. lut In a wMoaa vi hivi biia iittifl| up itrlv iln lo (iir) 
(r>: tbc tvo ritiat aithodi vi hivi dlicuiitd bivi bun uiidi id fit 

tti bov, iy oftly i aln|ll lutbor. By lir thi loit uldily uiid 
i(<aoi if iviluatlng |riduiti pro|raHi bii bun to iiiiii thi rl*- 
laareh rap^sititlon of thilr faculty by iikln| otbin In thtlr dli- 
clpKiDi - dtpirtiint c ilrilQ, iinlo^cbolari, junior acbolari, or 
ioi« coiblnitloQ - ti rati thai. Thli tacholqua hai baan mad, 
iQ 001 fori j: anoth^^r, !n thi two biit-knovn ritln|i, tboii of 
AUin Cirttu (2) aoi '.con ind Undiriio (i)» md ilio In thi itudy 
bf Lfidd i(td Llp'-«\ priUilnary findings wari luiiarltad 

p >ha Cliro(dj^j[^ • (»« ^^^kfi ^Bo- 

Thiia "rapuU^ton of itudlai hiv6 btati tha Last- 

i^ailiflcd and loit Infiuitit'il ol tU T\itin quality itudlii, but 
r:p9piiiii, for tbi ion yivt, onl/ V^ i;iii of * dipartiint'i 



fi c ul ty ind mulact ffoit other aapicti of it. Carttir, for hli 
pirt| did iocludi, il tha and of hli itudy, i aictlon In which 
hi ritid I tinlviralty^i library riiourcii ind thi ouibir of Iti 
griduitt atudanti vho had von national fallouiihl)-a, but ha lada 
no ittaipt to Intagrata thhl aaaiuria vith hia ratlngi of ficulty 
to fori oni) ovirlU laiiurt of dipirtiintil quiUty« And CArt- 
tit ind RooilrindlriiD both 'riid to rata not only thi quality of 
i dipartiantS ficulty but tha ovarall affactlvanaia of tha pro- 
griii yat tha tvo icoraa corralita ao nlirly pirfictly - for tha 
3( dlaciplinta itudiad by looaa-Andarain thi corrilitloni viri 
111 lithir 0^ .99, uiuiUy .99 - tbit vhit vii bilng iiiiurid 
VII cUlrly thi lilt thlQ|. 

Hhiti thin» li to bi donat to iitauri tha quillty of i ichool'i 
(rlduitl progrii In my dliclplini vl luit iiiiuri not only thi 
riputitlon of Iti ficultyt ii loit of thi ritioga do, not juat 
thi ibllity ot Iti itudinti, li RurlblrtS atudy dots, and cartilnly. 
not tba ititin Inatltutlon^ la Gouriin layi ha doai^ - but thi 
dipirtiiDt ItiiK) IncilUry dipirtiinti vhoii offirlngi could riiion 
illy bi ixpic^' ittri.t i lubilintiil nuibir of itudinti froi 
thi dipirtilnt giing ratid, ciipui ficlUtJii mi by tin diport- 
iint, ind thi idviDtigii Ind dliiilvintigaa of thi survouiidlng coi- 
nunity for thi lubjict biiog itudlid. 

^For ixiiplii thi rcaiirch potintlal o! Ilarvird Unlviralty'i 
foraat, locatad in cintril Naaaichuaatti, i^robably doii not vlttUy' 
iffict Ita itudinti atudylng Coiparatlvt Lltaratura In Caibrtdgi, and 
tlia fact that Nav htl llnivaraity, according to the Rooga^Andarian . 
lurviy, had tha bait art hiitory dapirtoint In tha country, light 
hava bam nora ralavmt to philosop|iy atudmta viahlng to spacialita 



Uhat follows U in outllni of i ntlng m =11 according to 
thi prhclplu «• hivi diicribid. «• will clmlfy our oiiiutiB 
Into tboM diilini with thi diipirtijiU bilni ntid, thosi Involvid 
vlth thUii outildi thi dipirtiint but on thi ^P^i «oJ thoii 
coacirnid with thi coKunltL mrrouodUi thi ciipua. 

1? Djpirtiiotil Hiiiii rii 

I. thi ficulty'i acholirihlp - thi ruiirch ibllltlii of 
thi Iiculty, ritid - 11 In amy |xlitlo| iiiliiiinti by othir 
icholiri In thi iiii dliclplini, 

b. i iount of tin ticuUy dtvott to tuchtn U i ijvtslpgi 

| uldln g itudiot rtanrchi ind itudint contict in giptril - in liHy 

highly ritid dipfiitimti tht loit vlilbll |)lopU, thi onii upon 

whoi thi dipirtiint'i rapuritlon li Urgily bnidt do liii tHichitig 

iDd idvlilog, ind hin liii (0"Mct tflth itudinti, thin Uii viU- 

knovD piopli. Thw uojtr 'i ^iputition for tiichlng iftictlvt- 

niii illy bi biiidi m^i 'ciici -tfi upon :hl riputitiooi of thoie vhi) 

do thi liait tir h(?< VH^ane^ U ntlng progrui vi ahouU 

conildir not only i"L nofiaaori' rQiiirch productivity but tha 

v.ip.ilbutlon thiy ilka tovarda taachlng ind «dvlaln| itudanti, and 

and 

n pre ■i'^L^ iho li oftin on laavi tlichii 1 ll^ht ichaduli uhio 
^* li ;.tt u^lum ihoald not "count" 11 «uch, in miasurlng 1 pro- 
itrii'a Uach^ng iffictlviniui, 11 ona ulio doia a full ahiri o{ 
tiidilng i i idvlilng. 

c. jji lUy of atudantg - thli would ba miiaurid by ORE 
iptltuda and ichlavaiant acoriB^ undiignduati gradii vilghtt^ by 
quOity collaga attandad. and in tha ciaa ?f aoai profMsionil 

O 
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Hastir'a progriisB itudinta' currint jobi ind cuoulativi ax* 
pariinci in thiir flild« 

d, ttudint participation In dipartaantj nd canpua Ut| 
thtai could bl aaiiutad both by thi parcij^tiji of fu)l-tl3i itudintii 
of itudinta who aarvid aa taachlng or raiaarch aaBlatanta, and of 
Itudanti vho Uvad on or vary mar caapua, and alio by tha abioluta 
Duabar of Btudanti In i dapartiaat who vara fully InvoIvid in 
dipartiant and cUpui Ufa. All things bilng aqual. prograr^a with 
I high patclntagi of luch fully Involvid studinti would bi ritid 
hlghtt thitl Dthlril hoviviti having a "critical naia" of atudanta 
tor otbiri to interact with li liportant, too, ind a graduata pro- 
grai wlthi iay» 100 ikudantai ^0 of who viri fuLl-tinire, would 
U fitld hlghir than a prograiwlth 10 atudanta, four of iho wira 
fuU-tliira. 

placatant racord of graduita_a - hin I would conaldir not 
only initial acldiilc appolntimta^ ai Hulbart doaa, but how wall 
thi prograa eirvid to idvanca all Ita itudmta' cariara. In tha 
caat of d Haitir*i ptogrii, for liaiDpli, I would conflldir tha pir- 
cantiga of Ita griduatai who wint on for doctorptaii tha parcantaga 
of thoaa who :ic;villy coiiplatjd thilr doctoratai, ttit quality of 
tha Ph.D-grinting Initltutlon thiy wint to, ind ilio thi klndi of , 
]ob0 thi tirnlnal t!aitar*i atudantf got, thilr Ptirtlng aalarlai, 
(ind - for thoia who wiri laployid bifori baglnnlng thilr prograi -* 
thilr aalarlai ind riaponilbilltlii, IfliidHtily aftar iirnlng 
thiir Hiatir'i, cofipirid to whit thui wira Juat bifori thiy intarid 
thi prograi* 



I. CUjiui-wIJi Hniurii 

iU'ngth of tihtid Jipartn oti In ritlng i Hatir'i 
pro|rii In Spiclil lducitlon» for iimplii I vould conildir thi 
quilltj of thi ciipui' psycholoiy dipirtiiot^ lipiclillT thi nunbir 
ind fuilltjf i)( thi courii offirlngi ind thi qtiillty of then faculty 
loit viluibli to I itudint itudylng Splclil Bducatloni lod ilio thi 
i ccHilblUt j^ of chBitf piycholoiy couriii lod ficulty to Spiclil 
Educitlon itiidinti. 

b. (ju illty of ciipm ficlUtlii I progrii driwi uppj - InitWd 
of uilni ilobil iiiitiriii IB doi8 CouriiDi Ind iiiigolpg i rltln) 
to iQ ifltlri iDitltutlQQ, I vould Ittliptt for I4ch progr», to 
riti than citpui icidiilc ficllltlli It 4ili^loit«_ U tU zUk 
of I Hiitir'i progrii la English, tor Impli, I vould ritt thi 
ciQtril unlviriity Ubriry md thi English or huunltlii llbritj, 
If iny, but Dot thi coiputir Qitvork| for i |)togrii In itt| tU 
ciipii' itudloi, iqulpiint, ind luilui colllctlonii It Inyi for 
I progrii In lociologyi both thi ciipui^ Ubriry hi Ui coiputir 
nitvork, Though vi cionot pridlct vlth cirtilnty, of count, vhit 
civpui rnourcii i progni'i itudinti vlU uii thin will ilviyi 
1)1 itudiati in Spiclil Educitlon vho hivl llttli or no contact with 
thi cflipui* piychology dipirtaiot, ind iom itudinti in lnh uho 
vlih to do coRputir-iiilitid itudlla - iilicthg thi cu v'^i ficlU^ 
till Itudinti In I glvin progrii in Ukily to un loit and niuurlng 
tbi quality of thoii li it liaat a atap In tha right Jlrictlon. 
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3, iurromlllnn Coimnlty 

riniUy, VI ihould conildir, lr\ aoitailng any progran'a 
(jttilUy, thi ciipua' vldir invlroni, ind vi ihould rati both thi 
couuolty'i Intilllctuil liblinci In giniril md vhit It offin 
for thi pirtlculir fllld bilog itudlad. For iiupli, Harvard and 
tic lirlclUy light viU lara I hlghlr ritlng for thilr nilghbor- 
hoodii vlth thilr lany bookatoraa Ind cultuiil opportunltlii, thin 
ichooli Uii favorably altuitid. 

Tiiriilog to rltlngi ot thi cnpui' invlronnent in tini of i 
pirtlcular flild, vl vould irgui that Hiv York City la i good lo- 
vlronikt to itudy loit pirtodi of thi history of viatirn irt, 
tlilhlngtotl) i).C. ii 1 |ood placi to itudy lacy lapacti of Aiirlcio 
govlrnlkti ind Ichooli v4ry nlir in ociin for IXIDpl« I thi 
Uahinity of hliil In Corll OAblis ind tIC Sin Dligo - in good 
pllcki to Itudy nixhk biology* Pu^jriis locitid In luch invlron* 
nidtl vodld bl tiiii tilghir, lU thlngi bilng i(|uil, than ilillir 
progriii Uii flvoribly altuitad. 

in ougglatlng that a gnat lany facton bi conaldirid In* ratlm 
graduati prograia, I ai aviri thit I hivl auggistid rating iodi 
things - for ixaipla, tha quiUty of i caipua' surrounding connunl- 
thit srI axtraiily hard to laaauri. Am I know that lo far as 
caipui inv^roniinta ara concarnad, is vlth lany othar thingii onl 
scholar^ Faradlii la anothar'a Purgltoryi and that aona paopli| 
particularly In thi llti 19601^ found tha Birkiliy invlroniint I 
havi Juat toutid an ixciptlonilty unpliaiant placi to bi. 

Furthinon, though t havi praised cirtaln typta of invlron- 
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ilQti •• Uiil iittlngi for cirUln dlidpUpii, It li cUir that 
thl (Iniit dipirtiiDti In thi country it* br no mm ilvijfli or 
IvlQ oftiQ, Id thi iittlngi liii vould iiii to bl thi loit hoiplt- 
•bli. For iiUpUt tccordlni to thi 1970 looii-Andiriin ritlngi, 
thi tlDiit Spialih dipirtiiot In thi country vii not layvhiri in 
thi Sunbilt but ritbit it Birvird, ind thi third ind fourth but 
Spinlih dipirtiiDti viri In dicldidly un-Blipinlc Hidiioni Vliconiin 
ind Fhtlidilphli. Slillirlyp thi blit Otriin dipirtiint In thi 
country vii oot In Hllviukii but it lirklUy, ifld thi fourth blit 
phlloiophy dipirtiint vii in Flttiburghi 1 tovn thit hii tiiiadid 
fiv piopli of Socritii' AthiDi. 

On th* othir hind, thou|h our nitf.on^i cipltil vould liti lo 
bi I good plici to itudy Aiirfcin govirniinti of thi nitioo*! Ik 
bht pjUtlcil iclinci dipirtiioti, igiln iccordUg to Kooii-Andiribn^ 
not oni VII locitid In Viihlntton. ta ihorti vi itiit bi zitihl Hot 
to vilgh I pcogriiS lovironi too luch. Hov luch, though^ li^^ougM^ 
Bo* luch iipurtiQci ihould vi iiiign to i«ch i^i out dlffirint 
iiiiuriif I( VI in riting thi ciipui^ lurroundlngi, thi ichool'i 
llbriryi lod thi quility of^ iiy» thi hlitory ficuUyi ihould v« 
vilght iich Df thill iquilly) and, if not, hov ihould vl liiign 
vilghtit Thill an iirioui probliii, to vhlch thiii in no ilipti 
loiutloni. iitlll and ill, by rating griduiti progriii on i lirgi 
Duabir of fictori, ind by valghtlng thiii fictori ippropclitily - 
dinicult II thli lay ba - va viU coia Buch cloaar to flaaiuring 
thi trui quality of griduita prograna than va do vlth tha ona** 
dlianalonil niiiuri - thi iiiiuri of thi faculty'a raaaarch rapu- 
tatloQ that la cononly uajd todayi 
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UTIIIZIHO WIITIPLE DIKENS10N3 Or qUALIH 
MJlIDCHEtltS or WS DECREE PROCHAKS 

Kint I, Jickion 

Onlveralty of Bocthcm Colorado 

Uucitlonil MMircheri ira Incteailngly concirneJ about lattara of 
(juallty lu iraduata aducatlon. Doctoral ptoiraia hava been the prliary 
tocua of chla concaiD, but Interest la now turning to the water'e dagree. 
Uaaarch and rhetoric concerned vith quality hae tended to begin froB the 
pecapectlve of vhat "ought" to constitute quaUty In the ilnds of acholari 
or graduate ichool deane. Studlea have not investigated what "doea" conitl-' 
tuti nuallty in the judgicnt behavior of thoii wet concerned yith gndiiate 
prografta, l.a. acadenlc adninlatratora, faculty and atudcnta. IMa papefre- 
potti on I itudy conducted it tha llnlvetsltj of Rotthern Colorado that 
ittMptid to Identify the ipproprlate dlMOilons of quality for evaluation of 
local luitir'e ptJgrese, and to aaaese the relative lupottance of tlioan dluan- 
ilone In th« actuil Judpent proceai. 

Ihe llMtetuM teveale a variety of reiearch epproachee to the eubject of 
quillty. The earlleit and beat known atudlei focueed on "projran excellence" 
(Helia, 19?0), inl provide preatlge and reputatlonal ratings oi' program (Hughes, 
1934; Kenleton, »59; Cartter, 1960; Rooia and Anderion, 1970). Theee atudlee, 
and otheri derlveJ tm theo (Knudien and Vaughan, 1969; Elton and Roae, 1972; 
leyer and Snipper, 1974; Itotgan and Hearney, 1976; Lpd, 1976), have resulted 
Id the Identification of i hoat of characteristics, Indlcei and dluenalons 
uaociated vlth ptograi quality. 'The work of Blackburn and Llngentelter (1973) 
rtpreienti the fltat effort to categoriie and organize these various technlijuea 
into » alflgle Mdisj or conceptualization for evaluating and copparlng degree 
program. 



Ifari recently, the work of Clark, llartnett and laird (1976) h»» 
itteipted to Identify, ftol l btoad range of prograa characterUtlca, 
thoae wit iBportant to judgnenti of quality In doctoral education. Furtber- 
Mri, thiy lought to develop lultldlnenalonal procedures for Judging quality 
Incorporating i griatec variety of Indlcatori and waaurei. 

The lultlpli dlneneloni approach auggeited by Clirk, et al., (1976), 
repreaenti a coBprehenalve aodel with poislble application to all Uvela and 
fotas of graduate iducatlon. The literature does not, however, reveal any 
ipeclflc attenpti to apply luch i lodel to tha evaluation of water'a progriia. 
Hor have previous atudlei addreaaed a nuiber of other considerations. Whll« 
research suggests a nuaber of progra. dlnenslons associated with quality, little 
guidance Is provided In ter»s of tha reletlve l«?ortance of such dlwnslons 
(Clark, Hartnett and Balrd, 1976, p.4). The underlying aseuaptlon would appear 
to be that the preience of quality dl«analons at high levels does, In fact, 
constitute quality. Actual ]udg«nts of quality, however, My depend on the 
relative liportance isilgned to given a'l«nslon8 as well as the extent to which 
dlsenalons are expreiied. The Interdepindence of quality dlMnslons In the 
]udg«nt process should also be coneldered (Lynd, 1976). Finally, auch of the 
reseirch and literature suggeste varloui uses for quality Information about 
graduate progrtas, but none exanlne the utility Issue eBplrlcally (Cartter, 
1966; Rooae and Anderson, 1970; Utenewn, 1975; Clark, Hartnett and Balrd, 1976; 
l.ynd, 1976; l|nt«an and Paletz, 1976). Underatsndlng how qualitative Inforsi- 
atlon presented tn a ™ltl|>U iimsl-M lomt h actually utilized In the 
Judgment proceea could shed light i broader queotUno of uaefulncna of luch 
Information. 

The wst obvious way to Identify the important elemnts of quality Is to 
slaply ask academic adBlnlatratora, faculty, atudents or others what they 
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nliM in di|i(i ptoinii. bindiUr. tMi !«• bien thi ipproich of pri- 
Tloui riiiirchKi lo ipl" a' "hit uy bi • iirloui lliltUlon of thti nthod. 
yUli wkjicti iiy bi lUi M W«ntHy the ln|ridlinti or dlieniloni of 
fuUty il»y coMldir lv«Mt, thiy uy haw difficulty ipodfylni thi 
nlidn li»o"«"« » Intertalitlonthtp of inch dlMuloni in ictuil judjMnt 
lltuitloni. Uchtinitlh iod Slo»lca973) Polnt to i virlity of hiwan 
julpiat itudlii In uhlch labjwti hw. difficulty ipedfylni tht dlwnilona 
thiy UN In utiti tbilt Judpcnti. 

m fori|0ie| tuMiry of relited llterituri luggiiti thi followlngi 
I) thi wltlpU dlnniiooi ipproich hii not biin ippUid to thi iiieiwnt of 
■Mtir'i proitiiii 2) niiirch ifforti bivi not i^ilrlciUy iddriiiid uttiti 
of tilitlv. lipdrtinci, Intirdipmdence, ind utility of quillty dlieniloni; 
iBd J) thi ditiet Inquiry ippnich uy hivi mm Inhirent Uiltitloni whM 
•ttiDtlni to ittdy JudjMnt hibavlor In thi contixt of ptopii quiUty con- 
iMiritloni. Thli itudy hii ittespted to diil with Mch of thiii cencerni. 
Ihi tint itip Ml to Idintlfy ipproprliti Hiiutii for iiiiiilni quiUty of 
Mitir'i progriu ui^ng thi Hdil luggeitid by Clitk, et il., (1916). Secondly, 
lybjiett iiiocUtid with iiitir'i progt'iM ii idilnlitritoti, ficulty or 
Itudinti win iihid to^iib Judgnnti ibout progrm bind on Infomtlon pri- 
iiiitid In lultlph dlnlfilon ptofUei. In thli wiy, lubject prefirincii for 
eirtiln dlKnilwi could bi luilnid without rilylng on thi dlrict inquiry 

Mthod. , 

Lni Hdil procidurii, dirlvid froi the theoritlcil ind lethodologlcil 
totwlitloni of rgon Irunwlk (1952, 1956), win id«pted to.thli itudy. 
Quintititlvi indlcii win obtilnid by ■enuring the nlatlonihlp between thi 
nlMi or livile of dlMniloni In thi pnflU description of i progrw, md 
tiN lubjictl JudgMnt of thit ptogrn. Iheii nlitlonihlpi were welyted for 



four (0 iubjict groupi including icidiilc idtlnlitnton, ficulty, iitimil 
ind riildint digtii uitir'i itudinti. It wii, therifoti, poiilbli to iiieii 
both the nlitlvi l^)ortinci of dlffirent dlienglona ind thi extent to which 
groupi of iub]icti dlffir In thiir uii of dliiniloai. 

METHOD 

Tbi purpoii of thii itudy win 1) to Identify ind operttlonelly diflni 
quillty diuniloni ipproprliti to the uieiiunt of uiter'i degree progreu 
It tbi Univirilty of Nortbim Colorido (UNC), ind 2) to iiieee the relitivi 
iiportuci of diuniloni in tbi ]ud|Hnt polidii of Indlvlduili ind gcoupi. 
Judgaiflt teek Mtetieli win divilopid which chirictirlted hypothetlcel degrei 
progreii in ■ bic greph for«t. Ih« lene lodel uai need ei the peridlgi for 
prieinting the progreie to bi obeervid end Judged by the lubjecte which In- 
cluded icidiaic idilniitntori, ficulty ind two groupi of uiter'i itudinti. 
Subjieti 

Subjicti coniiitid of four (M roupi with fifteen (15) in eich group. 
Student iub]acti win rindoily iilictid froi a llit of thoii uking ippllcitlon 
for griduitien whili inrollid during thi iprlng tin of 19J8. One group In- 
eluded only Choei coipletlng degrii progreu on ciqiui. The otiier etudint 
group included only thoee conileting iietit'i progrim off caipui through 
ixtirnil digree offednge. Feculty end edilnlitntore were lelec^ed on thr 
belli of their riiponilblllty for thi iviluitlon ind rivliw of griduiti prognw. 
Iicu'Uy lubjicti win iilictid it rindoi fto« thi Unlverelty Faculty Sinate and 
Griduiti Courdl. Adilnlittatore win eelected froi a eoiflled llet of pro- 
feiiionel itiff with ion then hilf-tl«e icedeilc adilnlitntlve reiponilblllty. 
Hiin iga, iducitionil and aex diffirincii were Inevlteble ind no atteipt wii 
ude to control theie virleblee. 
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Dm Collection Inittujjnt 

Ihi Inittmont uiid In thli itudy eonilitid of i "t ol ioitructloni ^ 
followd by 31 Jud|«nt tiiki. Tiik Mticlili cMprlwd at hypothetlc«l 
proirii yroUlii mini iivin geninl qmliiy dinniloni luigiit.d by Clitk, 
It (1976). Wnniloni win opiritioniUy diflned uilng t«o to four 
ipidtlc ■aiiurM. k Juty of ixpnrti, co^tlnd of k.y icideilc idilnlntritoti, 
chilrpitioni of :hi ficulty Senita ind Gtiduiti Council, ind i |t»duita itudont 
•••iitid In thi Idintlflcitlon ind iilictloo of ■••urn to diflni eich dl«nilon. 

Ihi quillty dlKMlOBi, » dlipliyid mini bir griph ptofllei fot iich of 
JJ proitui, iinid •• cuei conilitent with thi lini ndtl. Ibi cuii viriid 
• iloni dlBMloni luigeitlng dlffirent Uv.li of quiUty. In thli w«y, cu«i 
Hmd 11 potintUl Mdlitoti of tht quiUty levil ittilned by th. prograi. 

i lepiciti toiponie iboet mi uiid to ricotd lubjict Judpanti. On the 
niponM ih»t wre 35 iipinte crltirlin i.:ilii r"glng fro« I to 9; with 

9 ript(»ntln| tin hl|heit ittilnible livil of progrii qmllty. Eich of 'thi 
progtii profllii veti nuibired to cottiipond with iich of thi crititlin 
icilii. flw lobjicti' tiek wii to obiervi tin cui viluei of i ilngli ptogri« 
ptotlli, ind to nti tbi ptoirii iccordlngly on thi correipondlng critiilin 
lcil«. Cm vilu.1 ind ctiterlin icilii ihitid thi iim 9 point rinji Including 
3 locitloni defined ii "taong thi Lowiit", 3 locitloni diflned ii "About 
Aiingi", ind 3 locitloni diflned ii "A»ong thii Highlit". Subject Judgwnti 
wti bi«d, tbitefote, on coapititlve iitiwtei of ptogrii quality. 
?rocidur« 

Uch lubJict WII tilted indlvlduilly ovir 35 JudgKOt tiiki. In iich of 
the 35 progtai ptofUaa, cu. laveli ware lat witl. thi following conildetitioni 

10 ay I 1) tin (10) profUii weta preattingid to tut for iveriglng ind 
militancy tindenciaa; 2) ten (10) profilea wets pteirtanged to teat for 



ipadtic lofluaoeia of anvirooiint ind icadiiic offiring diuniionil and 
3) flftiin (15) ptofilii wen ptoittin|id on i rindoi biiia. The otdat of 
pceientatlon of profilaa virlid randoily for each aubject within each of 
the troupe to avoid affacta of fatigue. On the facing page of each profilit 
a euaaty of the dlianaione end weeuree need to deecrlbe thas wee provided 
for lubject review. 

mm 

To enilyta thi eubjecti uie of the eeven (7) quellty dlMnilone ae cuai, 
individual product Hient cocteletlon coeffidente (Peerion "r") wen eoa- 
putid on tbi crltfltii icilei for uch of the 35 progriu. Ittcie correUtloa 
coef (Icltnti leiiuu thi digrii to vhich iich of thi dliieniloni viry lyitin-^ 
itlciUy vlth lubJict ratlngi of pnirm (Bill, Glllli ind Stavirtj 1}]8). 
Cu« utilliitlon coiffidenti viri then convirtid to i valuei uilng Fliher'i 
r to I triniforutlon (rirguioQ, 1966). Subsequent inalyiei of variince vere 
pitforied on then nomlhed i viluii. 

The leea utlllietlon coefflclinte for eich of the four groupi wen luh- 
jictid to H 1 7 (iroupi by dlnnitooi) reputed teeiureienti enilyiie of 
virlinci, A ilgnlficint mIq effect vei obtelned otdy for dltferencee between 
dlMnelone. Ho uln effect wee evident IQ co^ierlng groups or Iflterectlon 
between groupe end dlienelonea The iilo effect for dlaenelons (r (6) " 71.675, 
p<a01) indicate that quellty dlieneione were uied differentlelly in Judging 
progreu. The ebeince of other lein effecte indicate that no eigoificant dlffer- 
encee appeared between groupe in tUir utiliietion pettemei 
Dlwnsion (Itilixation P attema for AU Groupi 

The pittame of diieneion utiliietion for all four groupe of lubjecte ehow 
coneidereble eiillaritiee, Quality of faculty^ reiourcea, elumi and overall 
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nitMwrt thi wt mi itllliid dlianiloni for lU iroupi. Dlnnilom 
oneinid with quillty of itudinti, onvlrotwnt ind icidnlc of fitlngi viri 
itllliid liiit< 

Dilni Kikii'l BflOpMCiduti for wltlpli coipitlMni (Kirk, 1968), ill 
inupi utillHd llM dlMBiloij cDncirnid vlth quiUty of ficulty iljnlflcintly 
BN (p<.01) thin 111 othir dlnniloni iicept iluvl. qmUty of iluni m 
Ml iliaKleintly vri thia qmllty of itudinti, invlronunt ind offirlngs. 
IwnU projru quiUty ind qiullty of riiourcii win lUo uiid ilinlflcintly 
on tkiB quilUl of itudinti, invlronient ind offirlii|». Qmllty of itudenti 
Ml uiid ilgnlfltintly ion thia qmllty of invlrooMnt. 
jiiBtUlcitlon qf Hituril Croupj 

Thiri biini no il|Blflcint dlffireoca bitwiin mipid iroupi, i Judgment 
nilyili prociduii VII pirfowd In w iffort to Idintlfj my nitural cluitefi 
ir iroupi rtii light ihin cown utllliitloii pittino (Chrlitil, 1968). Only 
no dlitlnct troupi iiiried froi thli pcoceduri. 

Ihi flrit |wup of fifiien (15) iub)icti wii coipoied pridoilnitily of 
itudiati vlth m ixtimil, m riildwt, 131 ficulty «nd 131 idilnlitritori. 
Ihilr mUiiitloB pittan virlid diitlactly fioi thit of ill othar lubJicM, 
Ihi avariia for ill mn utlllMtlon coefflcUati for group oni wii lubitin- 
tliUy lowr thin thi rwalnlng lubjecti, and wch liii virlitlon In utlll- 
latloa eoifflclinti wen obieniid. 

Iha rtialnloi forty-fha («) lubjicti coiprlied the Mcond group. Much 
lirgir, group tuo wii alio wri evenly npreiented by itudenti (421), faculty 
m ind aiilnlitratori (29:). Group two repreienti ill reialnlng lubjacti 
and miam to the utilization patterni obiirvidwlth all aaslgned gtoupi. 
Hiich graatar variation In lean MtllUatlon coefflcienta vera obeerved for 
group tw. 
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COHCLUSIOHS 

Tbla atudy atta^itid to apply a iutU-dlui<alonal approach to quality 
aaiaaiiant of aaitar'a dagrii pro|riii. Fiitthdmiori, the leni mdel uai 
iiplayid to iviluiti thi rilatlva liportanca of dlieniloni in actual 
Judgiant lltuitlona, 

Iha lavan (2) quality dlHnalona and prograi profile forut aug|iaced 
by Clerk, it il., (1976) idiptid vill to thi iiieiiient of uitar'a pro- 
griia la (be context of tlHC. Tbi luthor upirlincad no difficulty In wrklng 
vlth I Jury of ixpirci to Idintlfy and iilict ipproprlati Hiiuria. And, 
lubJicti Intirvleved In the couree of the etudy rtepondid fevorebly to the 
ipproieh. land upon thia eiperleaee, it eppeera that tha lultt-dlienalonal 
ipproich dole hold proilee In the application to quality aeiaiiunt of uitir'i 
progriu. 

Iha uit intiriitlng'flodlngi troi thii itudy iiy ba found In the analyila 
of diwnaloo utllixetion reeulti. UtiUietlon petterne icroii all leelgned 
groupe of itudente, faculty end edilnletratori vere highly elillar. The li- 
portiiise of e quellty ficulty end quality reiourcie vere paranunt In Judgaenci 
of prograi quality, kt an output weeura, all groupe eipheiliid the liportinci 
of quility ilunl. And, ii light hivi been ixpicted, the perviilva waeuraa 
eicttbad to overall prograi quality aiiund i ilgnlficint role In Judgunti of 
progriBi. I)uallty of invlronMot did not contribute liportantly to tha Judgienti 
of any eiaigned groupe. In euairy, graduate etudente (reeldent end aitemal), 
faculty end adilnlitratore eppaar to generally depend u^wn the eant dlueneloni 
of quality In rendering their JudgMnta, I.e. a quellty faculty, adequate ra- 

h 

eourcee, e eu^ceeaful aluinl and ovetall prograi reputation. They rely luch 
let! on Infonatlon concerning the quality of entering etudenta, or the extent 
to vhlch the envlronient end prograi aeet the expectations of faculty and etudente. 
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Thru ciiulti in not pirtlculirly aurprliln|. H)it iviliiitlva iffurti 
concimiil vlth quiUty iiaiiiMnt of iridoiti ' cogtm havi vilihtid Imvlly 
tba "wtirnil" chirictitUllci that ira both obvloua aiiJ aaally laflaiirad. 
Uhit la ol aoH aurptlaa, hovavac, la tha J»|taa of appirant alillirlty that 
mrial vhan coip.irlni tha utllliKlon pattarni of aaalpiad iroupa. It vaa 
iipactad that aaalgnad iroupa, by vlrtua of thalr dlf(arant vinti|a polnta 
mii judia quallcy lu aquiUy dltfarant vaya, It vaa in queatlonlng thaaa 
laaulta that tha Judiunt analyali ptocaJura uaa particularly uaaful. A * 
dlatlnct ''aatural'* iroup did aierga. rradoilnataly atudanta, thla group 
laioad tovatd a B)ra balanced use of all aavan (7) quality dlianalona ralylng 
Mich laaa on only thoae that partaln largily to axternal charactarUtica. 

Cittalnly thu raaulta of thla atudy are only tentative end Uiltad to 
the coQdnei of lucellty and deal|n, They do, hovever, eu|geet tbet a lultlpli 
dlianalona approach can be fitted to the iieeaiient of vitar'a progriu. And, f 
laeufllng auch an approach la amployed, thla atudy aheda light on the queetlon 
of ectual utility o! Infomtlon thua pceainted In Judgment altuatlone by ualng 
tha lane wdel. Mnally, by adding Judgient analyale to the inalyela of variance 
procadure, thla atudy polnta up the advantagea of being able to look lore doaely 
et elillirltlee end dlfferencee aiong aubjecte U auch Judgient experlaente. 
hrhape, through thla rather unique reeeirch daalgn, new lofonetlon can be 
Mde avillible th«t liidi to i better underitinillng of vhit "ought" to and 
uhit "doei" conitltute quellty In mter'e degree proiriM. 
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mmm \]\\M\ in mum mm\m 

PivlJ t. Uniinidliir 
(laiiiriiiliinil liiil|it fllllm 



ijHiUt^ I I loii nhit It 111 n't »»« tl""'' knw "I"* " 
lut Ihit'i Mlf-cDnttiillctory. lut im thln|i Ml bittK tliin 
^ ttlNr4, tlMt U, tliij liivi mt iiMllkr. Itit nlno t'7 'i 
iikit till <u«Uiy II. iput liM tl* IhltiM lint It, It 111 
loii Nori Tliiri'i nothlni to tiU iboiit. lut II you oin t iiy 
dhit (juillt; li, hov do jfou knw vhit It li, or how do |ou know 
thit It ivin Mlitit U no oni know uhit It li« thin tot ill 
priotleil purroiH It doiin't iilit it iU> lot lot ill piiotUil 
J purpii It mill DOU iilit. Wilt ilii Hi thi iridii bind ont 
Vh) till wold piopli pi| loitunii lot hm thlnii ind tbtov othiri 
In tk tdih/plUt Obvlouilf ion thlgii,iti hittir thin othiri. . 
. but Hhit'i thi unnmilti . . lo lound md touod rou |0| 
iplnnlnl until vhiili'ind novhiri llndlni my pliei to |it 
tiict:(on. ' Vhit thi hill li l)uilltyt Mtit II Ut 



In Ki t|l Hotntciell Hlio- 
lUMl 



Cu qiillllitUi dlllitinci br dlitln|uUhid uiln| quiotltlvi tichnlqoiil 
M If 10, do «• knoK inouih ibout vhit nwllty li to Miiuri It? Ihi iniwti to 
thiii qwitlou iti not cliit. Miili In {ID Iffl Hototctleo Hiln- 

tininci ptiiinti thi dlluM lo vill-Vu know vhit It li, yit you don't knni 

vhit It I " But ivih II our illoiti proyi^tttlli ind thi concipt oj 

quillty cootlnudi tft.iludi miurwnt, w hni no cholci but to try ind ciptuti 
thi iHin^i ol idiit quillty li. Vlthout undititindlni quillty «i irill not hi ibli 
to undititind ind lipro»i thi iducitlonil proem, tad ulthout loii Miiuti ol 
hov mil w do our ]ob, proipictlve itudmti iriU lick thi kUd ol Inlonitlon 
thiy ihould hiv» lo choiloi vhiri ind hon thiy irtll cwilt thilt illiitti. 

In thli pipit I aiwlni thi ipptoprlitinm ind uiifulniii of privloui 

iffotti to I quiltty through reputitlonil ritlngi ind lultlvirliti inilyili. 

hilldlni ilpon privloui riiiitch ind thiory, I ptopoii in iltirwtlvi wltlvit- 
liti ipprwch for eiplotlni thi litint ittuctuti thit underllii qoiUty-in 
iducitlon produntlon lunctlon lodil thit Idintlflii i ut of chitictitlitlci of 



iriiliiili iiliKiiHoii Hill UK riliiid m <|inllHii wd «<««lii«i li"" "ItKinnt" 
litloi liitirmt ulth ii«h otiiir iikI \m Ihiy m In ii4«d ii i vHnli In Miiuri thi 
i|uillty of iriiliMti idwitloui 

Tlirii cdndltloiii ir« lipottiiit lot d«»ilit|ilii| uiilnl linhnlqini to hum 
(iiiillty In iriduUi idiimtlon, pittlmiliily »t thi Hatit'i Htu livil, 

II liilni diti Ihit 1(4 iiUibli ind iiidlly ivillihlii 

n Ctiitlni iiiiuiii thit dlilininlih bitviin livili ol i|iiillty ilimi tlw 
intlii oontlnui ol pin|iiii Itn* thnii ol «i(y hlih quillty to thmi ol 
uniooiptibli quillty* 

u kl anit lipottintly, divlilni iiiiimnt tiohnlqim thit dtitiniuiih 
bituiin Inputi Into thi qwUty lunntlon ind nwtcoiii or ptodnoti ol thi 
iducitlonil ptociiii 

Uilni diti thit iri riU rtl' «H ""I"' " « " """" 

quillty, thi illort ihould hi ii lowponilvi ii poiilbli. Tli«u|h thi dMind lot 

locountiblllty li hl|h ind ihould loitit itloiti to quillty, budlitp iri 

tliht ind liv iddltlonil iinuroii vlll bi ivillibti lot m UitiitUii. rur- 
thitMti, thin iti liny ulthln loidiH thit in ikiptlcil ot opinly hoillli to 
thi lutein ol quintlllibly Miiuilni quilltyi thitifon, to uhinci thi probf 
hlUty of lucciii, ifloiti to iiuu quillty ihould bi ii Inobttuilvi ii poiilbli. 
lut In iddltlon to thiii ptiiMtlc tillou lot iilylni on tudUy MillibU llti, 
piifitibly diti In thi public doHln, thiti in iiplrlciUy lound riuou u wU. 
Diti thit in cotdonli collictid froi ill pro|tiM In i dliclpUni illoo iiilir 
ind ion nllibli coipitlioni of pro|tiii. futthition, In iiiiulni tlw quillty 
of itiduiti Iducitlon It li uuful, for tiklng itock of ptiunt clrcuMtineu ltd 
fot plinnlng lot thi futuri, to undintind hon thi quillty of vitloui pro|riu hii 
ehu|id ovir clii ind, pirhipi ion liportintly, uhithir thi dititilninu ol 
qiullt; thiiiilvii iri In Hui. Publicly willibly diti nki It poiilbli to 
ixnlni thiu trindi rithir thin trying to tecoflitruct diti Iroi ipurloui lourcii. 

rpn]|.f| «ff.| f^f thit dlitiniulll i Mt^f" ^"'1' °t ""'"t'' t*" ♦''t^^* 
rnnfjnuul ot DtOK - tliOil of 71^ hjih iUilttI tO thoil of UniCCfPHbU 



•91- 



.92- 



104 



„ ,,.«u, If .."•»nak.,Mto .If Uu. 

.,„«,.. H.,.h fMW l.i.Ul.a|.„«l Ml'"""! 
|'(.«.>HI «» M"!""* '"^ 

tk.,.t«... It I. 

„IUbl, |.i(M.n pt.,tm «J v,r,l.n • • «" • 

Hhf protrii i|Hill<y <llll*"* 

lUlUlE,ll4lttUUlJWaiUllU|JlllW 

UlUlioiiUluJMUtuiMUm^ 

luiiolm. th. o« '^-"''""'^ f'""' ' """" 

It II not, br it»u. • •""I''"' »' " 

.,U«t,t. *kh ».rloa. cMpoMnti |oU| Into th. •du.«lo».l pcoc.M muM» 
to th. o«tc«.(i). th«i do., not h.lp 1« ho" >" 

,r«.i, I«cl,.dl«» Input. l»to th. q».lltr Nctton .nd dl.tln|ul.hln, Ih.. Ir« 
.„t««.. ptoyld.. ln.l.ht into «h.t Uctot. «. k., In l.pt<«lni 1"»ltT .nd ho- 
thti. mlotti iictoc. IntKtct. 

lEiiiiiiUiiguf 

h.v. p.ovld.d th..d«ln.nt .pproich for .v.lu.tln, ,«lltT U ir.du.t. «l«c.tlon. 
n..|h r.^l.|. .r. Mt .v.ll.bl. in th. public dcln. th.y c.n b. ccplUd .t 

,.U,lv.l, llttl. ..P.n.. ""J «■ " " 

pdUH .e l.l,h pt..tl.. "d vl.lblUt,. B»t ..p«.tlon.l ..tin,. 1"« 
„.(„1 in dl.dng«l.hln| b.t«.n progru. of .od.t.t. .nd lo«r ,«lUy, p.ttlcu- 
Url, It th. K..t.t'. D.«r.. Uv.l, «h.r. ic«l«lc P«t. «. 1." Ukily to h.v. 
,urflcl.nt finlllitlt, to Judgi .d.qu.t.1, th. f«ll itt.y of progr.». Ih.t. «. 



1, (lit oMiitli, vli*Ht.i puiH|« l« I" 'l'«l"». " «• 
MUiH io *(iM.MHiiM "fliwllly r ^ " 

rtiliigii 

Th. i.loi Jf.wb.ck »f ritlni*, h..«.v.r. U ih*i th.y pr«vid. «« Aim 
,\m .hoiit liiiv to lipriw. .(irtlUf. »» *"''t"'''^" 
II .iniil..r vliit liiiKit Umn .r. cniittlliitliU to M|li«r ^« 
II iin(il..r xh.t oiitMMi «t. ii.ii(ilitiil ullh hl|hit inillty. 

IlllUlmlUUllllnUi Hoit of ihi put «iltlvitl.t. ti.>Hi.li".i lor MMM- 
I.11 .jiHiUtj^liivi tltlLt co«p.r.d .iipl. (bU.rl.t.) wnmm of v.rliblM 
or tli.y hiYi uiid lultlpli riiriiilon to ..il"ti thi r.l.Hmi.hlp hitviM 1 vm 
pirliblii ind ritlmi of quillty. Hii" itodl" """•"•"''"l' 
biiirtr, ind oiilol"'"' «" 

l.nii.1, th... iultlvitUt. .nilyii. in .bl. to dl.tlnMi). b.t«.n ptoir.i. ol 

quit, dlviriint quillty. VlrtoiUy nooi o( th. privlou mnt tithnHoii, 

hoviyir, h.y. dl.tln|«lih.d bit«l>n Input. Into thi .diictlowl ptooiii ul 
o»tco..i «f th. ptotiii. Iithir, thiy hivi conci.tr.t«l prl«rlly o« flidlni 1 
group of fictor. th.t could b. ui.d to lubitltut. for ritlni., with llttl. thiori- 
ticl bu. for thi ..notion of Hrl.1,1... I« "OJ "|tiiil»n ««»»'•■ 

hivi f.lUd to .mini th. lnt.rr.lit.dn.ii of th. lnd.p.nd.nt v.rUhl.i. 

. ' t 

T^^^^^y^^,H,„^»».nnl^..,fth.H.dll. Th. .ppro.ch th.t 1 pr...«t lo. 

,....,1„| ,«llt,. «ollo« lo,lc.lly ft- pt.vlou. .ffort. th.t Intrriucrf th. 
p„„biiul.. of .ultlv.ruti in.ly.1.. " d"*' "..vlly f.- th. th.ot, «l 
h.donlc ,«.llty ....urmnt d.».lop.d for u.. la th. fUld of .conclc. .«l ■ 
th.ory of pr..tl|. r.tlni function, d.v.lop.d tor u.. la •ocloloiy. thii- 
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Miilo|oui thMfUi provide • UmtoA for uiloi quiatltitl?! leiiuriient Uchnl- 
\m to aiirii vkit li bailciUjf a uon <quintUlibU niiih quHty* Thi hedonic 
(or r.hirietirlitlc«.) thiory poitulitaa that quality cm ba anvliioDcd ai the 
^Mi^tloB h quantity of the different aliMnti Into vtiieh the product uy be 
igcMipoea^ (Ita charactarlatlci)'* (GrlHchaa, 1)71). '*thua, the level of e 
Mrik^lar variety oi a 'product la eetabliihad by tbi' eiounte of the verioue 
ck,> eeterlatlca It contelnai" (Triplatt, 1971). The theory of occupetlonel 
praatlie, developed prlDClpelly by Duncini edopte a eiiiler approach) diaa||ratat- 
log oceupationa lato their coiponent chericterletlce froi rfiich e preetige func- 
tloa la derived* It |oae further i hoveveri eutieiiing a taiporal ordering of the 
charaetariitieai thuq dletlDguliblQi betvean thoie cherectiiriecice vhich precede 
teipereUy thi ereetion of en eccupation end thoia vhlch evolve frn the occupa- 
tion (outconaa i r^v proceee)> More recantlyi Kolitad hae aipendad thle pradic- 
tlfe theory iato i ceuail lodel lAich le ueef'jl not only la reting verioue oceupa- 
tiona, but aleo in baln| able to predict the eitant to idiich apeclfic cherac* 
terletice contribute to en occupation'e preattgoi 

Daacrietiot of the Hodal t I have coibinad the hedoolc approech vltb an 
ipproaeb thet dlatlngulebae betvaen Inputii vhkh ere trenafoned by the produc- 
tion proceee, end outpute, vhich repreeent the final product (aaa Teble t)i Aa 
Inpttte into the quality function, I propoei a eet of nine characterietice, or 
alaMati, of vhleh graduate educetioo le coipoeedi Ihie eat of inpute repraeante 
a piraiMnlotfi collection of raaourcee end eepaete of the educitlonal proceee that 
are perceived tn contribute to achieving the goele of educetioni An effort vae 
Bade not to oilt any verleblee thet tight be critical deteninante of quiiltyi 
rravioua etudiu, pertlculerly the 1979 CG8/BT8 etudy, vera uiad to detenlna 
ibieh verleblee vare Met critical. Four output Maiuraa vera eelicted ee proilaa 
for the level of quality echicved by progriie In pureult of verioue aducitionel 
loeloi Hultipln regraielon vae mad to aetliate the raletionahlp of the eet of 
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Inp.li to eech of the output laiaurae and to aetlute the relatlonahlp of both 
inpute end outputi vith eubjactive ratlnge of quelity. 

Keeulta * Thaea rarulta era froi teetlng the lodel in one field of etudy, 
aconoilca. The ipaciflc reeulte ere not ganariliiible to greduite etudy In other 
diiolpllnae, oor to graduate education belov the doctoral levil. I include the 
raeulti, hovever, to ehov the potential uaefulneei of thii hedonic educational 
production function approach to aiaeieing quality* 

Thoufh parciived progru quality appeeri to ba the beet elngla Indai tor 
aiiaieing quality, the raeuUe ehov that exeilnin| e nuiber of dlHAalooa of 
quality provldee e lucb broider undiretioding of prograi quality thin done eny one 
Mieure (eae Teble II)« leputettooal ritioga in riletad quite highly to tvo of 
the four concrete output leuuraa uaad ii proiiee for quality in thie atudy 
(icholarly productivity and dagrM productivity), but they ere uorelited to tvo 
proelee Muuring other diieneione of quality (equity lod cireir preparation end 
placaiant)i 

Thi eat of input characterietice la related to reputicional ratlnge eiid to 
tvo protlee for quilityi echolerly productivity, end eerier preperetton ind 
plecaienti The eet of input charactarlatici ii unreletad, hovever, to tvo of the 
deeired outcoiei of the proceee) equity end degree productivity! 

hdividually the Input cberecterletice contribute dltferentlelly to lech of 
the proilaa, though eoie particularly atroog trinde are evident i 

0 Inetitutiooal preetige le liportent to all Meiuree of quility, 

0 faculty ability and coipetance (a aliyle cheraetarletlc) ie highly 
reletid to perceptlona of quality, but not highly raletid to concrate 
leeeuree of output, 

0 tvo cherictarietice, inetltutionel elia end raeeerch ectivity, contri- 
bute very little in a poeitlvi vay to aaeceelai quality vithln tba 
function I propoaoi 

But in edditlon to theee findlnge, en enelyala of ilipia corraletione above thet 
the three cherietarletice contributing the loet to the varloue quality functiona 
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(InitlttitloMl ptMtlli, fitttUy cflipititici inl iblllty, lod itud.nt iblllty) ilio 
•ri mi l««wlitid. ttui, It li difficult to titlutt th. unlqu* coittlbu- 
tlot Ql Mch of then chifictitlitlci to tht vitloui rtUtlomhlpi. 

yfH il.^^, tht lodtl idb«ri to tht three rnniHHon. tftibllihed for 
iifiiritu auilltT? 

quentlflibli •eiiurii wre lelicted to repriunt iich of thi cheritterli* 
tlci outlined lo tible 1. Aliioet ill of the diti «te ivellihle in the public 
doiiin, though coipiteble flnendel deti on Individual ptogriM pro»ed ylrtuelly 
lipoeilbla to get. ly relying on public, quintlfleble diti, the rellihllltT of 
thi leeeuree eee whenced. In one eltuitlon, leeching eblUty, no edequite 
■eeeute eileted for the deelred cherecterletlc eo e tore eub]ectl»i eeieeeient of 
feculty coipetince end ability vei ueed tneteed. In leeeurlng the edequacy of 
(eclllttee, oplnloni of feculty wre uied beceuee prevloue reeiirch euggeeted 
oplnlooe vete n velld leeeure for thle cherecterletlc. 

Ae »lth other ioltlvirlete ipproachee the hedonlc-educetlonel production 
(unction dletlngulihee prograie ill eloog the continuu, fro. thoee of high 
quality to thoie of low quality. The principle edventage of thli technique for 
eeieeelng quality li that It not only pro»ldee en eeieieient of quellty, but it 
piofidee eon tluee ehout ho» ipeclflc chirecterlitlce ere functlonelly releted to 
' quellty. ror eieiple, In the field of econwlce, It eppeere thet locreeelng the 
itreagth of the feculty light veil lipro?e the reputetlon of e progrei end enhance 
ite icholetly ptoductltlty, but It wuld be unlikely to Inccexe the progm 
quellty In othur dlienelone auch ei enhancing equality of educetlonal opportunity 
or helping etudenti conplete their ecedeilc progreu. 

The cherecterletlci ipproech provldee e prnlelng technique for aiieeelng 
quality In gtiduati educetlon--e lore ueeful approach than any elngle lnd«, 
pettieulerly In Maater'i level educetlon vhere e lack of unlfon knowledge ebout 



vitlouB ptograi ukei rating prograua unttneble. The educitlonel ptoductlon 
ipproich provldee a technique for eeieaalng quality thet rellei on readily ewll- 
ab'it data, allom coipaclion of the entire contlnuui of progtaia froi thoie of 
hlgheit quellty to thoie of lowet, end ptovldee valuable Inforwtlon on hon 
apeclflc Input chirecterlitlce conttlbuti to enhenclng varloue dlieoilone of 
quality. There ate lliltitloni, honever to thle ipproich. Pltit, the let of 
Inpute ind outpute oeide reflneunt, vlth the pirtlculir need to Incorporite eoH 
crltlcel deterilnante of quellty. Sacond, the Interreletedneie of uny of the 
Input cherecterlitlce liilte the utefulneie of the epproach In luggeatliig the 
unique contrlbutlone of ipeclflc Input chirectetlatlc to the quality functlAB. 
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PDOIECIING IHE CONSUHER: THE WIE OF THE CONSULTANT 



Richard David Bresllni Ph.D. 
Assistant Chancellor for Academic Affairs 
The State of New Jersey 

IHTRODUCTION 

For many institutions of higher leamlngi survival depends upon their ability 
and/or Nllllngness to offer programs which meet current demands of our society. 
Various fields of study become Important at a given time because of emerging 
societal Issues, and one nay cite such areas of Interest as aging, death and 
dying, energy, cwnlcatlons, transportation and urban studies. There are obvious 
bona fide reasons for developing and offering programs which meet these societal 
needs. However, the 'bottom line" mentality should not be the one of Institutional 
survival, but rather the one of offering a quality product which will serve the 
student well. Ideally, the perfect program Is one which provides quality educa- 
tion and sustains the Institution financially. 

fundamentally, that which will sustain our educational Institutions Is their 
academic quality as well as the entrepreneurial approach they take In marketing 
their programs. While ^.^ie few colleges/universities possess such reputations 
that their very names serve as a wgnet for attracting students, most lack this 
charlsiii and must depend upon other means to enroll students. 

In most cases, If marketed correctly, a well designed, quality program should 
be self supporting. An esoteric field of study, or one which Is not oriented 
towards career preparation, regardless of Its quality, may not be able to finance 
Itself because of Insufficient enrollment. Excellence will not always guarantee 
survival* 

Moreover, graduate education today finds Itself confronted with several 
serious concerns: (a) a decline In the graduate student body has begun (confined 
by the Council of Graduate Schools, December, 1978); (b) retrenchment and reallo- 
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cation programs have cownenced on almost every campus In the country; and (c) some 
few graduate programs have already been eliminated while others face an uncertain 
future. Frankly, there Is no question but that graduate education has entered a 
transitional period. Consequently, as competition for resources and students 
Intensifies, Institutions must, If they have not already done so, take steps to 
Insure themselves and their current and future students of the quality of their 
academic programs. 

The basic thesis of thU paper stipulates that consultants can aid both 
Institutions and their students In assessing the quality of iheir academic programs. 

COHCEIIII FOR THE STDDEfIT 

Uhit must be of speclil concern to all Institutions Is the consumer, the 
student who enrolls In « griduite progrm expecting not only to be well educated ■ 
but also to do something with the Haster's degree. (Very few students are 
enrolling for the sole reason of love of learning.) It Is generally recognized 
that there 1$ an unevennejs In the quality of graduate programs on a campus; and, 
while a definite change has begun to emerge, once established. It Is still the 
Infrequent Haster's degree progran which a college/university dlswntles. Hence, 
the overriding concern In all graduate program evaluation must be; what Is It 
that gives the student assurance that the Haster's program In which one enrolls 
Is one of substance and quality? 

FntlllMTHlH!i FOR THE HASTER'S PROfiPAH 

Ideally, Institutions of higher learning plan Haster's level programs predi- 
cated on certain fundamental principles: , the mission of the Institution, the 
quality of fKulty and other Instrtictlonal resources, students with high potential. 
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flninclil resoyrces and the need factor. However. It Is ainost Impossible tor an 
Institution to consider each of these factors fm an unbiased perspective; thus, 
It Is essent<!* that an lipartlal expert assess the ability of the Institution to 
anunt i quality Haster^s degree prograii. 

THE CONSULTAHT 

To help an Institution determine the strengths and weaknesses of'a proposed 
Hester's prograi, colleges/universities ask Independent, respected experts to 
review the proposed progriRi. fbny State coordinating agencies Insist that, before 
State approval h granted, consultants will not only review but also Mke a 
definite reconneDdatlon concerning the substance (quality and all that that, 
arttraces) and the need for such a progrdn. I]ua1l^ ulnded Institutions, with the 
help of external consultants, In a cyclica] fash.on, review Kaster^s programs 
Mlilch art already In place. These evaluations of proposed and existing programs 
help protect the consuner. the student who enrolls believing that a bona fide 
prograi awaits him/her. 

m SELECTION AND BOLE Of THE COHSyiTAHT 

Bcfora establishing the nanner In which the consultant can assist the consi«er, 
1 should like to address the Issue of selecting the "expert." The consultant must 
possess recognized credentials and be perceived as a person with at leust a 
regional, If not national, reputation. Not only should the consultant be an expert 
In the appropriate field of study, but the person should also be neutral, objective 
and sophisticated enough so that he/she really understands the full Implications of 
an on-site visit. The expert knowledge of a field of study does not necessarily 
lean a person has the professional capiblllty of functioning as a consultant; the 
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consultant must understand the basic underpinnings of en academic program so that 
a review may wed the theoretical with the practical. The consultant must under- 
stand the dynamics of a program from Its Inception to the end product. In addi- 
tion, among other triteria, the consultant should be familiar with similar other 
existing programs, be aware of eif)]oyment possibilities, be knowledgeable of 
budgeting and financial matters, and have no past or professional relationship 
with the Institution under review. Doth the Institution and State coordinating 
agency should agree that an Individual Is acceptable as a consultant. At a later 
datOfi this can obviate numerous problems* 

irtaken seriously both by the Institution and the State coordinating agency, 
the consultant plays a crucial, even pivotal, role In detenilnlng the strengths 
and weaknesses of a proposed program. The consultant can be helpful to the State 
coordinating agenqy (as Is the case In New Jersey) In detennlning whether or not 
an Institution should nount a prograp. An experienced expert can be helpful to 
the proposing Institution by providing specific recomendatlons for anelloratlng 
and/or avoiding certain weaknesses and potential pitfalls. Above all, the consul- 
tant aids the student-consiner by Insuring that the educational services purchased 
are comparable In quality to those received by others .In similar programs throughout 
the country. 

Both the college/university and the State coordinating agency should expect 
trenchant, critical observations from a consultant. They should be consonant with 
reality and, thus, reflect the situation as It actually Is, Consulting is truly 
arduous work; and, If It Is to be done well, the individual must underUke the work 
knowing that a thorough evaluation Is an extraordinarily demanding task. In 
selecting a consultant, the institution/agency should ascertain whether or not 
the individual possesses this personal capability. Realistically, in this process 
there are several important factors at stake: (1) the reputation and the future 
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of the Institution, Including the faculty Involved In the program belnj considered; 
|2) the prafesslonjl life of *.he students who light wtrlculate In the prograi; and 
(3) the reputation of the consultant hWherself. Hence, the selection process and 
role of the consultant are It^ortant to the Institution, Its students and to the 
eviluator hlii/htrself. 

IHGREDIEHTS FOB tVAlOATlOH 

Fron a practical perspective, one can say that the role of the consultant Is 
a very direct and stralghtfoward one. Utilizing his/her professional expertise, 
the eviluator exanlnes fundamental benclmarks In assessing the quality of the 
Hester's prograi. Let me take this opportunity to cite the essential questions 
which the consultant wst answer critically; the listing Is certainly not Intended 
to be all Inclusive, but It senes as a point of departure for the evaluator. 
(1) Currlcular matters 

Does the curriculum represent a current and sound approach to advanced 
study In a legitimate field of Inquiry? Are the underlying educational 
• principles of the progran academically sound? Is the distribution of 
required courses, electlves and research appropriate to the purposes of 
the program? Does the program focus on the subject In such a wy that 
the student «lll be at the cutting edge, at the top of the state of the 
art, wen the person completes the Haster's level work? When It Is 
. appropriate, does the course of study pro'ide for Interdisciplinary work? 

Do the faculty possess the' appropriate academic preparation to offer a 
program at a high level of quality? Are their" professional activities 
consonant with the broad range of courses to be taught? Have they done 
their m research so as to provide the proper acadalc environment for 

•lo^ 

117 

er!c 



their students? Does It seem that the faculty have a genuine sensltlvltji 
to students and their needs so that students might really benefit from 
the program? 

(3) Institutional HIsslon 

Is the program philosophically compatible with the mission of the insti> 
tutlon? Does the program support and complement the Instltutlon's'philO' 
sophlcal goals? Is the Institution attempting to capitalize on a currenl 
phenomenon and perhaps abandoning Its basic educational thrust as an insl 
tution of higher learning? 

(4) Facilities • Fiscal Support 

Does the institution have at least adequate facilities to support the 
prograi? M are Its capabilities In the areas of the library, labora- 
tories and computer facilities? Does the institution have other educa- 
tional tools/resources available to wunt/malntaln a program of high 
quality? Do faculty members have adequate office space and research 
support (space, laboratories, aids) to benefit themselves and their 
students? Is there an institutional conmitment to fund the program ^ 
adequately to foster Its quality? Are the library holdings/periodicals 
reflective of the state of the art? Hill the student find an acadeiilc 
environment conducive to the advancement of learning? 

(5) Heed ' 

Is there a need for the program? , Is It likely that Its students.wlll be 
able to secure en^loyment 'and/or continue advanced study%n graduation 
Have needs-assessments studies been done to document the need factor? 
Vhat sampling techiflques were used to establish the question of need? ,, 
Kould the new program result In unnecessary duplication (proliferation) 
of programs? 
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(6) Students 

Art tl« lAlsslOM i«|UlreKnt$ predicited on a rigor which Nil! help to 
Insure the quality of the program? Are the student selection and counseling 
procedures adequate to meet the stated purposes of the progran? Are 
valuing fonis of financial assistance available to students? Can one 
assure the student the progran Is one of substance and genuine quality? 
(It nay very well be that should a prograai or a course not possess the 
quality It Is purported to have, the student should have sone neans of 
recourse, e.g., tuition refund. Obviously, this Is a controversial Issue,) 

(7) Proqrw Objectives 

Does the prograi meet the objectives stated by the Institution? Does the 
progran really reflect sound, conscientious acadenic planning so that the 
stated objectives are realizable and will promte a progran of quality? 

(8) Consultanys RecoMiiendatlon/s 

Having ascertained the responses to so nany Insightful questions, the 
consultant, now In aUlque position to aid the institution and/or the 
State agency, and protect the consuner of the progran, nist produce a 
report wliich details with specificity the findings of the ewluatlon. In so 
doing, the consultant really nust, in addressing each of the questions 
above in concrete tens, detail "the strengths and weaknesses of the 
prograi and nake definite recoimendatlons to anellorate m weaknesses 
which the evaluation nay have yielded. A definite reconiiiendation for 
approval or disapproval should be incorporated into the consultant's 
report. 

PHOBLEH AREAS 

There are obvious reasons for utilizing the expertise of a^skllled consultant. 
However,, the consultant system can fall for numerous reasons! 



(1) There Is, at times, the question of whose consultant the person is. Sone- 
tines a college/university eaiploys a consultant to review a progran and at tines a 
State coordinating agency nay do so. It slwuld BakenrdtTfereiicKwho hires the 
evaluator-the sane objective, honest overview should be forthconlnd. However, 
having been an acadenic dean, and having enployed consuUantsWaluate varioui 
Haster's level prograns, and now engaged In a StaU coordliating agency, I know that 
It does nake a difference who eifiloys the consultant. Frequeiitljty the caipus 
personnel will, perhaps unconsciously, attenpt to co-opt the evaluator. 

Campus based personnel share a special affinity with the evaluator; they will 
ask to share notes and keep in touch,before the final report is drafted. ,hey will 
tell the evaluator that negative coments can lead to non approval. As Innocent as 
things nay appear to be or are, they do. In a very subtle way, Influence the dynanics 
of the evalualor's report. Taken together, these innocent or sophisticated fons 
of behavior can co-opt the consultant. 

Concmltantly, a State agency can attnf)t to guide a consultant, and there can 
be a very fine line drawn between a subtle foni of indoctrination and the necessary 
advice and directlon'which wst be shared with an evaluator. Hence, the co-opting 

I 

of a consultant.can also occur In i State agency. One would like to believe that 
the liidepeiideiice and sophistlcftion of the consultant would obviate such a thing 
froa happening, but experience indicates that this is not always so, 

(2) Occasionally, a consultant's expertise can be so specialized that he/she 
falls to naintain a broad perspective, Hllltating against a study which will exanine 
both the broad strokes and the fine points of an academic progran. The consultant 
lust view the proposal In Its totallty.and not just sone esoteric 'points. 

(3) An out-of-state consultant can frequently bring a differenj^perspective 
to the task, but the person nay really lack fanlliarity with the local context. 
The objective view of an outsider can yield salutary results, but the local 
dynamics/politics also have to be'lonsldered. 
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(4) Personal, philosophical biases way prejudice a review. 

(5) perhaps the most difficult thing for a consultant Is to present negative 
comnts on a projran "developed by peers. There Is, at times, an unwillingness to 
state recwwendatlods objectively without ambivalence. There are consultants who 
lack the ability to say V to a mi prograni. The trenchant, hard hitting 
analysis shared In an oral report Is frequently weakened In a written report. 
There seeis to be a genuine reluctance to be openly critical, hence the Watered 
.down" written report syndrome occurs. ' ^ 

The Institution and the State coordlnatfng agency need to know about the 
strengths and the weaknesses of a program. The Integrity, of tl^ Institution h at 
stake; tht State agency has the obligation to assure the public of the quality of 
the program, and the consumer certainly has the right to be apprised of Its quality. 
Hence, the evaluator has the duty to present a thorough, objective end honest state- 
ment about the program he/she has been asked to review. 

Rot every program should be approved, nor should every program stay In exist- 
ence. Consequently, as the consultant attempts to protect the consumer,. It should 
be obvious that -Jie evaluation must paint the picture as It really Is. If this not 
be the cue, the consultant will hive perpetrated i rejl injustice on others is 
Mell as oil him/herself. 

(6) Mhen the State coordinating agency chooses to Ignore the consultant's 
report, the Inteiirlty of the consultant process Is Justifiably called Into question. 

In evaluating m or existing Haster's level prograns, the consultant should 
play a significant role In discerning the strengths and weaknesses of the progran. 
In undertaking this task critically, the consultant can protect the nknowing 
conswer, the student, who has every right to expect a Haster's currlculun of 
lubstince and quality. 
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Howeveri the consultant system can fall for various reasons. It will dis- 
function because of processes within the Institution or the State coordinating 
agency, or because of inadequacies within the consultant hlm/herself. However, 
.there are several recoomendatlons one can make to insure the Integrity of the 
process as well as to protect the consuner of tlie final product. 

RECDHHENMTIDHS 

1. The selection process for consultants must be a rigorous one that will Insure 
that the Individual has the academic credentials and breadth of experience to 
examine the whole picture. 

2. The consultant should be told, unequivocally, that a critical part of the 
^evaluator's role Is to protect the consumer who should be able to benefit 
from the program, 

3. The charje to the consultant should be specific, delineating with exactness 
the nature of the review expected. 

4. Provision should be made to Insure that the consultant cannot be co-opted, ^ 
even subtlely, by the institution or State coordinating agency. One would havi 
to be very direct about this and indicate the ways In which this could occur. 

5. The consultant's report should be Indepth, detailing the strengths and weak- 
nesses of the program. At least two examples of exeinplary consultant reports 
should be nade available to each consultant so that the person will know what 
is expected. One would have, to take appropriate measures to Insure the confl- 
dentlallty of the original documents. 

6; The consultant's report should make very definite recociuendatlons, Including a 
statement as to whether or not the program should be approved or not approved 
or approved contingent upon certain nodlflcaffons within the program. 
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BQUVIOR-BABED TEACHIHO EVALUATION FOR 8FBCIFIC EDUCATIONAL FtlOGRAllS 

Hilton R. Blood 
CeorglB Institute of Technology 

The Froblei 

Amdi tht uny dlwailona that are liporcint in th« aifleainieat o( the 
quality of aJucatlonil piogriw la the reactiooi of atuJenti to the teaching. 
Although thli ia only ona of the uaauirn •( the aucceai of cducationi Ita 
lipoitanca ii loietiiea asagerited becauaa of Ita availability. Student 
ratlnga are often tfde when other potential leaaurea ire not. That ia» in 
the abeenee of peer aviluadon, atinderdlied atudent achievenent Maiurea, 
or other aaaeaaieDta, atudent ratlnga are often the onlj teaaure. 

Aa the student body ia e etucial conatituency of any educational 
prograii atudent ructlona provide valuable Inforution to the faculty who 
are evaluatetti to ediinlitratora, end to etudante. 

There are unj probleii inherent in the proceee of one individuel 
eveluatlng the perfonaoce of enother (eee Zedeck & Blood, 197^, chapter i; 
Landy i Farr, 1978). Bven aaeuvlDg a good-feith effort on the part of the 
eveluetor It ie difficult to Interpret the Inforution that ie provided. 
For tbie reepon orgenlMtionel peychologlete have given a greet deal of 
ettention to the pertonance evaluation proceee. A firet itep in the 
enheoceMnc of the value of interpereonel eveluetiona ie tfie uee of a 
atandtrdlted procedure. Thie hee the edventage of Making evaluationa 
directly c«if«eble. Ueually a rating proceee ie uaed, and evaluationa are 
aaked to provide their eeieasaente on e etendard eet of reeponae categorlea 
(e.|., very bed, bed, neutral » good, very good) and a etendard aet of 
evaluative dlaenalona (e.g., initiative^ conaclentlouaneee, knowledge, 
coaiunlcAtion ablUty). Both the diacnilone and the reaponee categorlea 
in typical ratlnga are eubject to a great deal of interpretation leading 
to ayiteaatic blaaea In the way they are used (Guioni 196S). Theae blaaea 
in the tanner that evaluatore reapond to ratings can result in the outcoBca 
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giving wtt Infoniatlon about the peraan who did the rating or about the 
rating aituatlona than about the perCorvance that was rated, 

Indeed I when the epeclfic reting lltuaclon la one where atudenta are 
rating inatructore a nunber of influences have been found that intrude on 
the rating proceaa (HlUer, 197B). Theae dlaturbancea detract fron the 
ability of the ratlnga to reflect the actuel teaching perfomance. Ratlnga 
nay be influenced by} (1) cbaracteriatlce of the atudenta auch aa the 
anount of previoue college couraawork (Frey, Leonard, & Beatty, 1975; Gage, 
1961; Uvell ( Banar, 1955; Riyder, 19681 Rodin & Rodin, 1972), (2) content 
of the couree (Baaein, 1974; Rayder, 1968), (3) daae alie (Crittenden, Norr, 
k leBaiUy, 1975| Gage, 1961; Kohlan, 1975; Vood, Llnaky, & Straua, 1974), 
or (4) whether the couraa la required or elective (Gage, 1961; Lovell & 
Haner, 195S). Uith all of thue Interferencee in the rating proceaa it ia 
extroMly liportant thet procadurae be developed to liniiiie the anount of 
reapooea blaa In atudent ratings. 
Bequireienta for a Solution 

Vhat are the charactarietiCB of ueeful etudent eveluatlonaT Firet, they 
should be conatructed ao ai to provide inforaation that ie leanlngful. That 
Mane that the reting procedutea ahould counter reaponee biases lo far ea is 
possible, end they ahould live inforution thet is coaiperabla ecroee reteee 
and raLere. Second, the rating reeulte ehould be epeclfic. Va{ue alluaione 
to general qualitiea or overell eeeeeeaents tell very little about what vent 
on In the claearooi. The person trying to derive infomation froi en overall 
rating (adalniatretor, rated feculty Mflber, etudent) luet interpret the 
leaning of high, ledlui, and low ratlnge. The interpretation will undoubtedly 
reflect the bellefa and values of the Interpreter. Third, the evaluation 
should provide a baeie for a constructive action response. A perfonance 
evaluation should contsin within it instructions for iaproving perfonance. 
That instruction ohould say what la to be done, not just exhort the petfomer 
to "do better next tiu/ \ 
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BjhivloriUy Anchond Siting Scilii 

Id recent yeari i petforaince ippriliil technique hii been davolopod to 
riepond to the eccuticy, epeclflcity, and ectlon-orlcntatlon renalreaentfl 
juet Mntlonud, A ipecKled eet of proceduree i« followed to oonatruet 
iveluAtioo dlMnelone celled behaviorilly inchared retlng acaee (BARS) thit 
ue« daecciptione of behevloce to define the reeponee cetegorlee of a eet of 
dlmaloae (Cupbell, Dunnettei Arvey, b HellervU, 197]| Sdwabi Hanafluni 6 
DeCodlei 197!i; Sedth k Kendell, 1963), Becauee of the procedures by which the 
lAlS are davuloped they have • ouobar of poeltlve featurea when uaed In retlng 
pecfonanca. 

The Met aallent feature of the BARS le their definition of perfon^nce 
In tana of obeervable behaviore. A critical incident technique (Flanagan, 
iiik) genaretaa deecrlptlone of behavioral apiaodee that define the ecale 
polnta (and thereby the acala dlBenelonfl)* IF la not neceseery to tranalate 
avaluatiooB froi geoerel treit naftee (e.g.» dedication, huun relatione akiU) 
into ura concrete tema. Scoree ere already epeclfled according to relevent 
bebavlora. It li eeiler to underatand the leening of theee bahaviorelly 
defined avaliatlone, and It is eaeier to evoid reacting dafeneively to a 
low avsluaticn. One can hardly react other than defenalvely to e low urk 
on e trait-^naie acale. The natural reaction to 'lou're not vary 
conacientioui," ie "Jei| I an/ But if a BARS evaluation saye %\i don't 
return quluee within tvo weeks," one can react with e diecueiion of the 
behavior ratter than reacting to an attack on ooe'a character. 

A second feetura of BAIS ie that they represent salient perfonanee 
dlMDaioDB. The parforunce epieodee that anchor the acelee are generated 
by Mibera of the population who will do th« rating. Students would be 
need to conetruct BARS for atudent evaluatlone. Inappropriate dlaensione 
■ay be produced by deriving acelee frm other than the population of raters 
(Bonun, 1974). Thie can happen if ecalee are developed externally to tlie 
aituatloa In vhich ratlngewill take place. 
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Third, the leaning of the reapanae categorlea on the BARS are etplrically 
verified. Uhereae, in a traditional tatlng procedure there le no check 
against the problei that one rater's "extreoaly good'' la the aane ae another 
rater's "(air;* the BAIS procedure ueee e double elblnatlon syateii to screen 
out acale anchors that do not have agreed-upon »anlng. Every beliavlorel 
episode is subjected to tvo Judgaente In sh eipirlcal savple drawn froii the 
rater population. Bach Itci ia judged aa to the perfonianca diNnsion it 
represents, and all iteaa with IqH sgreeaent ere dropped. Then, each Itea 
is rated sa to the level of petforunca it represents, and all Iteu vlth 
large verlences are dropped. The finsl pool of scsle anchors therefore 
contains only those iteae that bava unequivocal leaning throughout the rater 
population! 

A fourth feature of BAHB is that they ere etated in the language of the 
rater population. Since the bahivioral Itaie are generated in a eaipla of 
the rater population, thay reflect the Jergon and nuancee of that {K)pul8tlon. . 
Thia feature lends credibility to the ecalee aiong raters and helpa to give 
tbei leaning. 

Finally, but not leaat liportently, BARS can be tailored to the apeclal 
featurea of the organiaatlon in which they will be need. Beceuae persona 
in a situation generate the behavlorel incidente froi their expariencaa) 
item contain the speclsl eiphaaes and properties of the prganiistlon. In 
educational aettlnga, including reaearch experiences, visita to field 
aettlngs, tutorial teaching, independent study projects, internships or 
other distinctive sttributai tbs behavioral eplsodee that anchor the rating 
diienslons would describe relevant eventa. 
A Specific Case 

As a f iret atep in tha devalopient procedure the IS students in sn 
organixatlooal behavior couraa in a prograi leading to a Kaster of Science 
in Industrial Kanageient degree were eaked to designate appropriate 
evaluation dlAenalona for eeaeaslng teaching behavior in their progrei* 
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for iich dlmnilon (um • oni^iititinci daflnltlon vii devilopod throu|h 
group dlMUiiiloD. FourKisn pirfomnci dlMniloni vare Idfintltlfld (ipb 
Tibli 1). Thin, then iiia itudinti vera aeked to provide bihevloral 
Ineidinti thnt llluetriUu r^or» appropriate, end good petfonance on each 
dlMneloQ. Ilila taeultad In a total of 630 (15 x U x 3) bahevloral Iteai. 

Ai la ueuil In thle pbaae ot m davalopient, the 630 ItcM contained 
mj radundatclaa and uny lte«a that vera not deecrlptlona of obeervebla 
bahavlora. The Itcu vera called to ellilnata dupUcetlona end nonbehavioial 
aplaodai. IJa raaultlni 2U iteaa vere edited Into en V«ctitlone" forwt. 
That 1B| the bahavlora vere reaceted to deecrlb« pertonance that ^ould be 
npeeted" or "yo" vouU expect/ 

k eupli ot 100 etudeote la the prograi then ude tvo Judgiente for the 
Uet of Itaii. ritet, each of the 2U Una vae categorlied eccordlng to the 
perfoninca dlMnalon It lUuatretec, end lecood, each lte« vae ceted on e 
7-polttt ecale according to the level of pertoriance It rapreeeatad. Iitlnge 
ranged froi 1, extreaely poor behivlor^ to 7, utreiely good behavior* Iteia 
vere illilaited If the agteeient ee to the dlMoelon repreeented vee leaa 
than SOI or If the variance ot the ratlnga exceeded 1.0. Theea ellilnatlon 
etandarde filtered the epleodee Into a final pool of Iteu vlth conaenaua 
00 their perfonance dltenelon and level. 

When the final pool of lte»a vae grouped according to dlieneloha, five 
of the original U catigorlee did not have euftlclent Itese to conetruct 
eeelee (eee Table 1). Thle loee of diienelone can happen becauaei (1) .the 
dlaanalon la too Ill-defined to allov the epeclflcetlon of llluetratlve 
obeervable behivlore, (2) the dlienalon la eo eliUer to enothfir that tha 
Iteu concelvad tor It ere categorlied eti repreeentlng other dlaenalona, or 
(3) there la lov agreesent aa to the approprlatencea of the epeclfled 
behivlore. 

For tboa^ diienelone) vlth aurvlvlng Item, acelee vere constructed 
uel&g It leiet five Iteu to enchor the aeenlng of ec&le polnte. Itefla vere 
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pieced on tha ecelea et the point of their noan rating* An exntnple of one 
of tha Bcelee, objectlvily, le dleplayed In Table 2, 

The nine ecelee vere pieced In booklet! vlth e cover sheet and 
Inatructlona ao thet they can be uaed by atudenta to evaluate performance. 
Bvaluatora ere aeked to lark the point on the ecele that repreeenta typical 
behavior of the profeeaor being rated. The behavioral Inddente define the 
acale polnte by providing lUuatretlvo exaaplee of the behavlore thet vould 
be rated at verloue levale on eech dlianelon. The behevloral enchora give 
aubatance to tha leaning ot the dlaenelone end the reaponae categorlea. In 
ueing the ecelee, retere ere not reetrlcied to urklng ecele polnte that are 
defined by behavlorel Incldente, nor le It neceeaery that they have aeen the 
proteeeor do one of tha Ueted bebevlora. 

Since profeaaore can eee the dlMoalone In advance ot teaching a eourae 
In Che progru» they can knov vhit klnde of behavlore vlU leed to high or 
lov etudcot aveluatlone. It a proteeeor recelvee a lov retlngdnfonutloo 
le Bvelleble In the acalea to auggeat behavlorB thet vlU eern higher retlnge 
In tha future. 
Conclualon 

An extrenely laportent leeue in the collection and uae of etudent 
evaluatlone la tha leaning that can be eicrlbed to the ecoree that are 
elicited. Behavlorelly ancborad retlng ecalei (BARS) define the rating 
dlienslona end tha reaponee cetegorlee along the dlienakna by epedfylng^r, 
the behavlore that are rapreaanCed. Thle approach aide retere In laklng 
accurate uae of the ecelee (Bonan & Dunnette, 1975; Caipbellp Dunnatte, 
Arvcy, li Hellervlk, 1973| Kaavaney & HcGann* 1975), hovever, the paychoietrlc 
superiority of BARS le not unefulvocelly eupported In the reeearch literature 
(Bernardln, 1977; Bemardln, Alvaree, & Cranny, 1976; Bonan ( Velloo, 197«; 
Burnaaka i Uollian, 1974; DeCotUe, 1977; Frlediao & Cornallna, 1976). Rateca 
prefer BARS and the intonation provided by the behavioral fonat proiotee 
iQproved perfonance (Ivancevlch, 1979). The procedure for developing the 
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Tabli I 

DiMniloni (or Iviliiitliig Tiiohlng 
In I HiiUr nf khm hi Indiiitrlil HQi)dyuii«nt hnm 



A. lnoMlfl(l|i of lubjict - (Icionstritlon ol ixpuiuri and axpertlaa 
in I KibjicC ireii 

B. Orijinliied Mtarlil* - thi axtint to which tha protaiaor prapuaa 
and priiienti tha lubject latarial in a lo|lcal| cliar, and conclaa 
iannaci 

G. Tranadir o( knovladga - axtant to uhith tha profaiior catiiaa itudents 
to acfulra a vorkini knowUdga and undaratandlni o( tha aubjacti 

D. fair iradini - tha axtant to which gradaa reflact dnonitratad 
parionanca on announcad claia goalai 

I, Ttit ctnatructlon for appiopriatanaaa - tha axtant to vhleh taata 
ira a rapraaantatlva aaapla of tha doialn of couraa content. 

F. Taatini: aa a laatnini altuation - the axtant to which a itudent 
knova wra about tha aubject or la lora avara of vhat a/ha doean't 
knov altar tha taat la CMiplatad. 

C. Concaro tor atudanta - Intaraat In tba acadeilc and peraonal valfaca 
at tha atudanta I 

H. AvaiiaMUty - the extent to which tha profaiaor la accaaaibla to 
atudanta outalda of the claaerooRi 

I. Encouriga original thinking - ancouragea tha atudanta to generate 
queitlcna and Ideaa. 

J. Fonallty/lnforMllty - tha extent to which tha profaaaor adharaa 
to a rigid and atructured zlm teaching pattern. 

R. Objectivity - opemlndednesai vllUngneaa to Uiten to and conaidar 
atudent input. 

I" Expoaa atudenta to own and othera' reaearch - the degree to which a 
profeaBor Inttoducea tha atudenta to own and othera' research In the 
Bubjact aru. 

M. Hcanlnptul aaalgned work - the extant to which the aasigned work 
contributes to the announced claaa goala. 

M, Coal aettlng * the extent to which the profeaeor Ideatitiea the 
couraa objactivaa. 



TmIiIq 1 

Olilyclivlly 

Iteuilndfidnoui wlllltigiieda to llntan to aiiil coiialJer ituilent Inpiit. 



? _ 



You vouU expect thla profaaior to llitaii tu all atudant 
Input In daia dlacuaalon, and by dlicuiilng atudanta' 
Ideaa in claaa ihov tha atrangthi or waiktiaiioa of tha 
atudanta' ideaa. 

tou would aipact thla profaaaor to aniwer quaatlona 
of tha atudenta, end apand idaquate tisa dlicuaalng , 
atudent ideaa. 
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You would expect thia profaaaor to liitcn to all 
atudfnt input but not to dlacuaa tha Ideal in detail. 



-ill 



Tou would expect thia proteaior to acknowledge the fact 
that a Itudent baa ipokani but nove on tha lecture/ 
.7^ dlacuaalon in prograii. 

You would expect thia profaaaor to ancouriga claisrooi 
^ dlacuialoni but aoietljiea ridicule atudent input, 



2-^ 



1™ 



You would expect thia profaaaor to rafuaa to liiten to 
atudent Input. 



*llndecllned dlsenalona were retained In the final scales. 
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All tooloKlonl AoHDnmiil. at) {)m Coinpoiuiiit hi 
RvwIiiftUoii of ()ff^(I«iii|)iiii Oi'Hiliwlti Vmnm 

PiidUlii Hull. 
IhUvDriil ty of Now lliiv«n 

orr-*Otiti|p\iii gi'Dihiiito (Itigrflo prngronii) Iiavh to ba evuliialml In 
UnQB of ill!) DKtniii. lo y^lilnh iliuy tiHtififlt froni iliii iiilvniitagHii at 
oantrallzatlon l«e,| ara fidHQiitlally Identlool to niHonmpiiti prn-^ 
gtamai but they must nUo be Jiidgod on tho degroo to wliloti ttmy 
benefit from ttio poaalbllltloD Inherent In docentralUatloii 
1.6., the unlquo oharaoterlotlca and opportunltlea at off-cnin- 
puB locatlona. 

Ono fluch characterlatlo la the relatively largo proportion 
of what CQDflara (197B) and othera have referred to aa the "Hon- 
traditional" atudenta viho attend extenalon oentero on a part^ 
time baala exolualvely. For theae atudenta, attending achool la 
a aecondary rather than a primary life activity. Thla haa many 
nuaningful iDipUcatlona; not all of vhlch are ooilnouBi Unfor* 
tunately the use of the term "Non-tradltlonal" all too often 
ImpUea a D^anlng which Itself preveijta the univeralty from 
benefiting from the opportunltlea avillable vhen planning for 
part-time atuciantfl. The term "Non-tradltlonal" la often used 
in auch a wiiy aa to, blame the victim for refualng to cooperate 
and being like "traditional" atudenta. It could Juat aa eaaily 
be aald that the difficulty realdea not with the "Non-tradltlonal" 
atudent but vlth the "Partially reaponalve" university which la 
Btructured oaaentlally to meet the needs of "traditional" atudenta. 
Whatever elue la Included in evaluation instrumenta for off-campus 
graduate programs serious attention must be paid to the Issue of 
university i^esponaivenesa to publl(^^ who happen to be part-time 
students. 
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M 1110 llalvHrMty nf M \\m\\\ ww \\\)\\m\\\^ ihmvIiioIM 
{\m[M)\\ \m\ \m\\ \]\\m\ whloli wo In \k ijrniliitiin t\\\\m\ vlow ad 
hiiltig of iiHinh Iradur lii)|iort, U Iho uHptirUiKm wt \\m\\[\\i m 
H.IKA, k^m al; our offM^aiiipua oontar In Mm (ti looi^tlnii in 
\i\\dm\ iMiiiimilliitil) HlitilUr in llio ())(|ii)p|ijh«ii) of mMm m 
H,B,A, (legrtia at. our off'^oaiiiiinii nantor In I)i)nl)nt7 (ii \m\\M)\\ In 
North WwflUrn (Innneotlont)? 

Our (Iroion olunHea are nffarud In n m\\m\ (\W)i miiltl- 
luvol, rod brick I praoilcally wlndowleaai atatu regional toolinloal 
aohool, The Bohool \m an energy navlng ollmute control aysten 
regulated by a computer wlUoh haa been affootlonately named "Hal", 
The building la altuated on a hilltop anrronndud by 100 acrea of 
state owned open land. Thla Bite wea a former Indian encampment 
overlooking long Island Sound. Many of the atudenta are either 
naval personnel from the sub baae In Qroton or employees of the 
Electric Boat dlvlalon of Oeneral DynamioB* 

The H.B.A. olaaaea In land locked Danbury, on the other hand, 
are housed In an office complex Inconaplcuously altuated amldat 
a typical extended atrip shopping center with a movie theatre and 
a supermarket as anchor points. Students arriving for olaasea 
park In the aamo huge parking area aa that provided for Bhoppera< 
They walk towarda the eame line of atores; enter a set of large 
glass doora where they find themaelvea facing a lobby directory 
on which "IINH aecond floor" is prominently displayed. 

Some atudenta at both the sites described are pursuing the 
same H.B.A. degree from the University of New Haven. Does it 
matter that the two aettinga are very different? It la commonly 
assumed that whatever differences do exist are epl-phenomenon and 
have no meaningful consequencea. How valid la that assumption? 
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Th«r0 1b a rapidly growing and already loipreaalve body of 
literature irtilch in Its loat extrene fonos takes a position ap- 
proxliatlng eYivlrcnnental deteralnlBn. Environmental eettlnga 
are leen aa capable of being highly coercive towards the behavior 
of the people who Inhabit thenii Huch human behavior la considered 
situation specific In that people, In the long run^ cone to meet 
* behavioral expectations and rules built Into places. People In 
a church engage In passing behavior In the corridors i seated 
listening biihavlor in the pews and u])rlght social behavior In the 
meeting curea. Vhen social behavior occurs In narrow corridors, 
while others are trying to pass, all sorts of signals are sent 
urging conformity to implicit rules i.e., the expectations of the 
setting. 

The behavioral expectations of any given setting may be 
communicated by a plethora of environmental cues such aa archi" 
tectural design, the pattern of placement and jtype of objects 
which fill the space and the messages emitted by other occupants 
who themselves fori part Df the environment. 

If an Important element in the learning process is behavioral 
change and If environments are capable of being coercive towards 
behavior than any university Interested in learning has to, at 
least, entertain the possibility that the learning environment 
may help or hinder the learning process. 

Some of the coercive features of the environment discussed 
in the literature appear more germane than others when considering 
those particular environments In which off-campus programs are , 
offered. At the Graduate School of the University of New Haven we 
are In the propess of developing instruments with which we will 
attempt to measure similarities and differences from csmpus to cam- 
pus. These results will then be compared with program outcomes^ 
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The balance of this paper will suggest some of those dimen- 
sions that UNH will be Including in a final instrument for meas* 
uring the ecological aspect of Its off*campus programs. 
Level of Hanninj^ 

One environmental characteristio that might well be expected 
to vary from oanpus to campus Is what Barker and Oump (1964) de- 
scribe as the degree to which the setting is undermanned. All 
settings have basic, functions which must be performed in order 
for the setting to survive in its present form and meet the needa 
of its Inhabitants, A university campus for example needa people 
to perfom the teaching function^ the student function, the main- 
tenance function r the admlnUtratlve function, the advising func- 
tion, etc. If all of the roles are adequately filled it could be 
concluded that the setting is optimally manned. Undermannlng 

might take the forms of an adjunct instructor who is not prepared 
to provide adequate advisement or of a class composed of only six 
students who for whatever reason are not at a point of readiness 
to make meaningful contributions in a dialogue with the Instructor. 

There Is a growing body of research findings which Indicate 
that occupants of undemanned settings are exposed to Implicit 
and explicit presaurea which coerce them to perform all the func- 
tions which are necessary in that setting. The results are sur- 
prisingly satisfying to those involved: they feel more competent; 
they sense a challenging opportunityi they feel more important; 
they become more Involved in the group; they experience personal 
growth. These findings have been demonstrated in high schools 
and in studies of small and large churches; wby not off-campua 
graduate programs? If these findings can be duplicated" at the 
graduate school 1ml they would suggest one way in which off- 
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cBipufl proitruB may actually have an advantage^<!ver the same 
progravs oihcanpusi 
The Social _Envlroniaent 

Another dimension of an environment la the people viho pop^ 
date the space. Sella (1963) and Linton (1945) take the poBl-' , 
tion that nmch ot the cultural environment la represented by 
other people. This position auggesta that the character of a 
peopled environiQent can be grasped if you have some way of pro^ 
filing the character of the Inhabltanta. The example given ear- 
lier of oui' Oroton location being populated by people who either 
were membera of the Navy or employees of an organization depend^ 
ent on navel contracts raises the intriguing (even If oversim- 
plified) question of whether there la a degree of ^military mind 
set^ that ffay permeate that learning environment. 

Astin and Holland (1961) developed an instrument, '^The 
^ Environmental Aasesament Technique" which permits the charac- 
terization of a student body by utilizing the choice of major 

« 

fields represented at the achool, The ^EATi* breaks down majors 
into six types of characteristics which set IJie tone of the so- 
cial environment: 

1. Realistic (agriculture, physical education, engineering) 

2. Intellectual (architecture, mathematica, philosophy) 

3. Social (education, nursing) 

4. Conventional (accounting, library science, economics) 

5. Enterprising (political science, foreign service, 
industrial relations) 

6. Artistic (music, english, fine arts) 
The Physical Environment 

Using the very same categories as those in the "EAT\ 
Holland (1966) descfibea environments according to the types 
of activities they are designed to houae. Thus, an engineering 
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lab would be considered a "Realistic*' setting. The comparison 
of a personal preference i.e., choice of major, with a given 
environmental design would reveal compatibilityi 

In order to' compare one canipuB with another we need com- 
monalities and a reference point. Thinking In terms of the 
previously cited examples of our Oroton and our Danbury grad- 
uate centers there were indeed some commonalities. Aside from 
the obvious similarities in program content we w^t to look at 
the milieu. They both have classrooms, corridors, a building 

'\and external surroundings or grounds. Furthermore, each of 
theae concentric environments can be broken down Into the phys- 
ical structure, the activities which typically take place there 
and the people who usually occupy the space. Thus, for example, 
in Groton the' external surroundings are natural fields and wpod- 
land which are usually absent of people but ihich entice stu- 
dents to engage in tikl^ng a panoramic look at the expanse of 
scenery. In contrast oiiir^ Danbury site is surrounded by stores 
and a theatre >lhere shoppine^and window shopping are engaged in 
by a large heterogeneous group of people who are drawn together 
by the magnetic attraction of the 'goods and services available 

J in the shopping center. A reference point which we hope to study 
is the extent to \rtiich each of the Bbove'^^oncent^lc eqvlronnentB 
la perceived to he conducive to the leamlni! procesB. To il- 
lustrate, we will ask each student tha extent to which the other 
activities which go on outside, the building in which his classes 
are 'housed are conducive (it at all) to th* leamlngNprocess. 
Level of Haintenance 

Before moving to a new facility at one of our centersN 
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UNH claflfles vere held In a loc^l public high school. The hl^ 
school adilnistration was having Inordinate difficulty in ex- 
erting control over the buildings maintenance. The heating sys- 
ten vould frequently be Inadequate to the New England winters. 
There were frequent breakdowns and ineffective heating even when 
the Irnlt was operating. IXiring the day the school was overcrowded 
and running on double sessions. The custodians and high school 
adainlatration were not able to keep up the necessary maintenance 
functloni Vhen^ our students arrived during the late afternoons 
they would find theoselves surrounded by sticky floorSi residues 
of ioodf lunclrbagSi Candf wrappers, etcV^^^to^^ would rarely 
be equipped with tissues or hand towels. Our students would fre- 
quently have to sit still through a three hour class all bundled 
up because of the low claasroon teoperatures. 

Inaglne, If you will^ larrled graduate students in their 
20's and early 30^s, who were often esployed in middle Banagenent 
positions, lAio had Dade large sacrifices to attend graduate school i 
enduring these indignities. That would have been bad enou^ but 
to lake patters worssi the hi^ schcjol adninistrators, who then- 
selv^ere under Increasing pressure fron the local board of 
aducftlon, started looking for scapegoats. They bscaine convinced 
that the graduate studento were responsible for nuch of the prob- 
lem and decided to withdraw the privilege of buying coffee at the 
cafeteria during breaks. One evening ednilnlstrator took to con- 
fronting instructors and students and berating then as if they 
were irresponsible children who needed lecturing. In this way 
a maintenance problem was transformed and started to poison the 
socisl atmosphere. After fiultless negotiations it became clear 
that we had to movei 



Permanence verBua Transience 

Attending graduate school is a major commitment for stu** 
dents, At stako are money, time, effort and self in the sense 
that long range plans can only be pursued at the expense of 
short range alternatives. It is not hard to understand, there- 
fore, why off-campua students are acutely conscious of any in- 
dications of faltering commltiiient on the part of the university. 
Vbat kinds of things are taken as indicators of commitment? An ' 
office with a receptionist and a telephone (identified with the 
univer^slt/tt^ at the site, counterbalances the ephermaL ^ 
impression given by a center that is open only during classes and 
operates only witiiin classrooms. Providing students with notices, 
school newspapers and all printed Information distributed on the 
main campus reduces the sense of isolation anc^ la taken as an 
indication that the university cares enough to r^e It happen. 

A high turnover rate of faculty makes It difficult for stu- 
dents to identify with someone representing the field. Graduate 
students need mentors \A)o provide a eynbolio bridge into the 
field. Mentor relationships take time to develop. 

Sufficient planning of schedules if important for each cam- 
puSi Class cancellations, inappropriate or untimely offerings 
Indicate that insufficient attention la being paid, Since the 
administration of the off-campua programs has to be coordinated 
from the main campus, which is frequently separated from each cen- 
ter by many factors only one of which Is mileage, a communications 
, network is necessary; At the most rudimentary level the univer- 
sities phone system must not place unnecessary obst^les in the 
way of contacting the off-campua centers. Trunk lines with waiting 
lists discourage phone communicationi At an Intermediate level 
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le the coBiiunlcatlon iwceaaary between university rapresentatlveg 
and the repreaentatlvea of the organlzatlona froa vliou claaiirooo 
. space la being rented. At the nost abstract level the university 
should be prepared to systematlcany asiiess the educational needs 
of current students and of potential students, 
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MADTIR'B PROORAM RtVID/ AT A SHALL IISTIIUriON 



Katherlne llu)Uy,C3J «nd Rlchirl Ognlbene 
The College of Salot Dose 



Although a qfitu of hgulw cooprehenslYe academe prograi review la cndoraed 
ifld Indeed .preiuied hy the Council of Graduate Bchooli, the aemal regional , 
uioelationa of graduate achool deana, and the bureaui of higher education In 
the leveral atat^a. and although the body of literature on acadeilc evaluation la 
m^t rmh wwieric adalnletratora deairlng to lipleaent a ayatev of . 
progra* reYlev on their caapuaea face lone dlffkultlea not alvayi acknovledged 
if the uaoclatlona or tha reaearch. Flrat, the adalnlatratr?! are probably 
far lore faalUar vlth the literature aupportlng program ravlev than are thfllr 
faoultlei, aoat of vhoa ^ulte appropriately apend their reading energlea In 
Ihelr reipeetlYe dliclpllnea. Second, the proapect of prograa review, once 
Introduced, vlll prlaiwhly have aore appeal tot revlaveri than revlevees. 

U a aiall Inatltutlon, particularly one which offiri no graduate work beyond 
tha laater'a degree, the dlfflcultlea are coq)ounded alnce luch of the dlicuealon 
>f prograi review la predicated on doctoral progr'ua. Ite now-deflnltlve 
reaearch cohluct«.l hf Nary Jo Clarl under the auaplcei of the Council of draduate 
Ichoola and Educational Teatlng Bervlce utllhea daia gathered froa PhD-grantlng 
Inatltutiona and dlacuailon at a recent COS leetlng enphaiUed the difficulty 
In ualng thla COS/HS atudy In the 'lultl^dlaenilonal or non-research degreee 
lueh u the KAI or DAT." There can b«. u another ^rtlclpant at the lae COB 
leetlBg reiarked, •'an air of unreality' In the dlacusalon of the aaater^i degree.^ 
la addition, efforta on the part of acadeilc adiinlitratori to ah&re research 
laterlala on progra review with prograa faculty lay backfire and cause faculty 
» reject the entire topic of progria review ai unrealiitlc, overaophiaticated, 
M threatening. Mora indirect aeaaures are neceaiary in order to focus inatltu- 
lonal atti!ntlon on this subject. 



Hanley It Ognlbene 

At The College of Saint Bose, a liberal arts college with a total population of 
2;00 and a graduate population of SOO atudenta apread over fifteen graduate 
prograia, the subject of prograi review was first introduced in 19?% The Idea 
had been given Infonal airing for soia lontha prior to Ita fonal articulation 
and there wu a general, if unspokeUi consensus aaong graduate faculty and 
prograi directora that prograi review would be beneficial to the inatitution. 
It fell to graduate adilnistrators to devlie and propose a syaten for the review 
proceaa Itself, 

Several assuiptloos structured our thinking; a aystei of prograi review should 
be tailored to the needa of the institution, should elicit data necessary for 
planning, should be aa direct and.u realistic aa possible, and should landate 
confrontation of probleii without becotlng unnecessarily threatening. Aa a firat 
effort (regular review of graduate prograia prior to 19]; wu aasoclated only 
with rereglstratlon procedures undated by lew York State. and did not involve 
policy comitteea) the' review procesa ahould involve u lany prograi faculty aa 
possible and ahould produce a rather forul docment for study by leibers of the 
Qraduate Acadeilc Cosnlttee (QAC). A proposal was accordingly developed, 
diicuBsed and approved by the Qraduate Acadeilc Coenittee, and iipleiented during 
ttel9]Hi year with the review of three graduate prograis. Ihese first three 
were volunteered by their prograi directors i aubsequent designations of prograia 
for review have been lade by the (IAC« ' 

Briefly, our present revlev procesf la aa follows: During the aumer QAC leetiog 
of each year, four prograia are designated for review during the spring of that 
acadeilc year. Prograi faculty develop the review during the year with assistance 
of the dean's office and any other appropriate persona. %t review Is presented 
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H&nley k Ognikne 

It the flrit ipring CAC neetlng, ordinarily In March; prograa faculty explain, 
clarify, and cowcnt on the revlev docunent and reapond to qucatlona liy QAC 
■eiberi* Follovlng thia wetlng faculty have approxliately one nonth In vhlch 
to reipond lore fomally to OAC jueatlone, returning to the next wetlng with 
foJlo«-up docunettatlon. At that meeting a forttl vote la taken to accept or 
reject the revleii docunent. 

Each review docuirent contalna the following prograa Infonwtloni 

1. Alva and objectlvea of the prograa 

2. Adiiaalon criteria and poUciee for the prograa 

3. Provlalona for acadeslc advialng in the progran 

it. Optlona poaalble in the progrei, for inatance internahipa 

5. Description of final evaluation, for Inatance coaprebenaivea or theala 

dafenae, in the progran 

6. Data on studenta adnitted to candidacy and graduated during the past 

three yeara 

7* Beaearch fadlltiea and both atudent and faculty reaearch projecta 
8. Future dlrectlona and hopea of faculty for the progro* 
9; Veaknesaea and problew of the prograa aa Indentlfled by the faculty 
10. Other Inforwtion considered appropriate by the faculty. 
Aa can be aeen fr:B the above Hating, the review doctment w:JiblneB data-gathering 
with faculty analyala and evaluation. The opcn-endedneaa of the document allova 
faculty to IncorpDrate any naterlal they consider important, a way of leaaening 
fear of progran-t^prograa coaparlaon. Not surprialngly, the flrat two years of 
review generated iocunenti vhlch were top-heavy with factual data and conparatively 
weak in reflectivs analysis. In the past two yeara the docunenta have become 
wore detailed aa faculty have. confronted problems and have wde recowendatlona 
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both to one another an J to the college admins t rat Ion, Ab faculty have become 
iore familiar with the review proceaa and have read more of the supportive 
literature in this field, several programs have deaigned and Incorporated 
InBtruaenta for obtaining Input from atudenta, graduates, faculty, and» Inj^e 
cases, speciallatfl outside the Inatitution. 

The beneflta of a program review proceBa of the above sort can be determined by 
two factors: the diligence and thoroughness of the group preparing the review 
document and the yllllngneas of the Graduate Academic Coialttce members to react 
honcBtly and firmly to the presentation, from the beginning both factors were 
positive: faculty worked well, If aomewhat fearfully, from the flrat year of the 
review and QAC members reacted specifically to each presentation. It la perhapa 
not surprlaing that the first three reviews, all "volunteer," were directed toward 
three exceptionally strong graduate programs, biology, English, and rea . , 
consequently, although OAC membera issued several directives and requeata v r 
foUov-up action, they vere not confronted with any major difficulty. The second 
year called for more decisive action on the part of the OAC, which placed one 
graduate program on probation with the directive to return to the policy 
cowilttee after a year of study. Even more serious weaknesses were discovered 
in a program reviewed during the third year; the review document for thla 
program vaa rejected altogether and the program faculty were told to atart over. 

Several benefits can be cited for both the review process and our experiences 
with it during the paat four years. The proceaa Is realistic and relatively 
Bimplo; U haa evolved from the chiracter of the graduate Bchool and reflecta 
the distinctive elements of the situation at Saint Roae. As an example of 
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fonatlie) rither than aunatlve, evaluation, It vould leea to' Illustrate the 
advantageiiDoted b7 Aodenon and Ball of an evaluative letbod vbUh Bteae frov 
th« nature of the problem? At tbe ease tli^ It Incorporatea nanji If not loat, 
of tbe "dl»enfll0Qi of qualHf" notsd in the CQ8/ET9 naterlalii landatlng specific 
data and directing faculty to be guided by criteria establlibed by tbe profesilonal 
aiioclationa. Aa the proceia bas evolved, tbe 4ocuMenti produced each year 
have becoie lora topblitlcated, iore detailed, and aore cognisant both of current 
ceiearcb and tbe need for Input froi progras cooitltuencfei. Blnce the review 
proceii li a coMiun&l one, prograi faculty are forced Into rather cloae Interaction 
vltb one another and vlth the graduate dean; several probleia and veakneaiei have, 
ai a natter of fsct, been addreoied In lull ^ups without^ ever needing to be 
articulated in t^e larger coanlttee. Prograf faculty, especially tbose in areas 
vbere research Ij aUost alvays theoretical, have gained enonaous eipericiuelji 
developKnt of sjrtey Inatrunents, organltatlon of data, and analysis of problens. 
Without landatlng unnecessary and Inappropriate progran^vlth-progran coaparlsons, 
.both faculty and QAC lenbers have, nevertbeless, realhef that certain programs 
havei for a varltsty of reasons, stronger and lore clearly articulated objectives, 
tore satisfied s'ludents, lore creative research activities, and lore clalns to 
acadeilc faiei Finally, confrontation, redirection, revision, and both praise > 
and condemation have been poaslble, thus strengthening the graduate school and 
its prograia. 

Disadvantages should alao be noted: revlev docuients nay be only as strong as 
progra* faculty luid/or the staying povewof the dean; and prograa faculties, 
vblle noting prohlesu, nay be inclined to place blaae for the proUeifl elsewhere, 
thereby necesslti^ting adalnlstrative intervention. The OAC, although flra In 
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Its rejection of certain revlev documents, bas not yet been faced vlth possible 
teminatlon of a program, although that situation nay be developing at present; 
It Is not certain hov successful that effort vlll be. The revlev process does 
not, it should be noted, address 'Itself to Batters of cost effectiveness and 
financial support; these satters are addressed by the college budget and long- 
range planning comlttees. 

The College of Saint Rose can nov look back on four years of experience vlth 
systeiatlc revlev of naster^s prograas. Clearly the process Is a vorkable and 
beneficial one, It is evident novi hovever, that the Institution Is ready 
for the next step: a aove to a nore detailed and aophlstlcated process. There 
Is strong faculty support for this mve since faculty are nov experlentlally 
coDTlnced of the necesaity for regular revlev; consequently ttenost recent 
SAC leeting establlabed a aubco«lttee,to prepare a nev prograi revlev propoaal* 
The Bubcojqpdttee, vblch vlll haye Its leetlngs In February, 19T9i has several 
hopes; to elUlnate any aapects of the progran vhlch seti do longer necessary 
in the docuAent; to incorporate acie features, anong thes a provision for student 
participation In the revlev, vhlch nov seeis appropriate; and to organize and 
unify tbe entire process vlth reference to tbe'^COS/ETS laterlal and other research 
vherever posslblOt Convinced of the value of relative simplicity, coooittee 
mesbers hope to retain a brief evaluation instruaerit; this document vlll, in 
its first draft form, be available for diatrlbutlon at the Conference on the 
Assessnent of quality and vlll In turn quite probably be modified by findings 
of that conference. 

■136- 

^4'^ . 



REFERENCES 



1. %ti ud LliitBtions of DiienBlona of Quality Study** and **Probing the 
HMter'i Desrce," ProceedlngB of the Seventh Annual Meeting of the 
Couocll of - Iraduate Bchooli In Uie United SUtei, pp7Tl-61 and lli2-152, 
lev Orleani, 1971. 



2. Bctnia B. iiderBon and BmucI Ball, The Profefltion and Practice of 
Progrti Eviliatlon, Josaey-BaBa PubllaherB, San Franclico, l97fli EMbIb. 



A W&-DIHERSIONAL HODEL FOR DIE EVALUATION 
or MASTER'S PROGRAMS 

Erneit M. Schuttenberg, Ed.D. 
The Clevalind State University 



Coaceni for iccridititloDi praiBurei for iccountibilityr iD<i desire 
for profeiiioael eicellence require that ttaiter^i progriu be cviluitid 
In tern of the quellty of itudeat perforwnce if tar graduition. In order 
to attiln I relitlvely unbilled picture of itudent perfornancei it ii 
deeiribli to gither diti not only fio« the griduitei tbeuelvei but ilio 
froi their evployiri, Rie piiuge of the Fiilly Right! end Privicy Act 
of 197* (P.L. 93-579) , hovivir, bai brought to light i nuabec of probleii 
concening the collection of luch ditit 

Thii pipir deicribei ind dlicuiiei the ipproach thit vai recently 
uied to iiieii the quility of i HiitirU Frogria in Bleientary end 
Secondiry School Adflnlitritlon it The Clevelind State Univeriity College 
of Education. Thi daiign of the itudy reflecti an ittwpt to gither 
evaluitlvi diti uieful for deciiion «klng irhili protecting the rlghti 
of the pirtidpinti^ 
Deiip of the Study 

^The ujor eieuaptlon behind thli itudy vii thiC perioni vho ire in 
I poiltion to obiervi the idilulitritlTi perforiMce of griduitee of i 
Miitcr'e Program Ifl School Ad»ifliitretlott wlU ba ible to provide power- 
ful eviluitlve InforMtloD ibout the progren.' 

OtlilMlly th« dMlgn of thi itudy vti to be i iliple oi)«i iup*r- 
vlioti of tlioM progru griduitei currently holding idiilniitntlve poiltioM 
In the ichooli would be eeked to eviluete the graduatee' perfomince'ln key 
edalnletritlve ereei. Thli deiign had to be lodlMed for two teeionii 
(1) the riiily Mghti end Irlvecy Act of 197* ptohfbite the dlecloiure of ' 
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diti ibout iadivlduili without their knwledga ind conient, ind (2) Bupet- 
iQttndcnti of School!, whoie oplni6(;i wen iou|ht, wen nluctint to lupply 
•viluithi IttforHtlOD ibout thilr to id outildi »ginc7, 

Thi floil deilp, thirefoto, wii lof^ coiplM thio the orlglDil one. 
k Utter (Appeudli A) wii lent to the thltt\-elx luiutu i*o, eccotdloi 
to dipiruentil ticprdi, pteiMtly h«ld poiitibne In iducetlonil ediinli- 
tretlon.' Thle letter eeked thei to eviluiti thi\auillty of edilDletritive 
prcpintioa tbet they ncelved in the Mietir'e Progtu in School Adilnle- 
tretlon.' Cnduetee w«re eleo Inforwd that i il«ller\ueetloiineln would 
bi iiat to the Supwlntwdtnti of theit echool eyitew ee^Dg thn to 
•viluati the Hiettc'i Progru baied oo experience with one o\ki graduetee. 
Griduataa va^a aaked to ntun a cii'd (AppendU B) If they did dpt want 
the quaitlonnilra to it Mlled to thalt echool eyetei. \^ 

Aftir the deadline for receipt of cerde hid peiied, Lettere (Appi^ndU A) 
tnd Eeiponee Sbeete (Appendli D) were iilled to Sapitintendenti or to Imcdi- 
ita auparvlaora. if that were lora appropriate, biied on thi particular \ 
•dilnlatratlva poaition of the graduate* \ 

Liyal of Reep om \^ 

Two of the gnduatea returned the Reapoaae Card eiUng thet the queetlon- 
mite not be aant to their achool ayatet. One of theee petaona indlceted thet 
hi wee not e graduate of the Heater'e Progra, but had wnly tekao ao»e of 
the couteei. The other pereon no longer held en edilniatretlve poaition. 
The letter to a third graduate wee ntutned, end U wee liter detertilned 



\ 



Hh Table I for e breakdown by poaltlpn of the 36 greduatee eumyed, 
^ii Appendix C for the Reaponae Sheet for gnduatea. 



Chat thia peraon waa no longer working In the field of education. Of the 
reaalnlng 33 graduatea, 22 (671) returned the Reaponaa Sheeta, and theic 
teaponiea are reported in thle atudy. 

letten end Raaponae Fone van aent to 33 auperlora of graduitea 
frofl the Heater 'a Frograi. Reapooaea were received fcov 29 peraons (881), 
and their reapooaea an alao reported in thle itudy. 
Ovenlew of Flndinge 

Ihe euperlore perceived the Heeter'a Prograi In School Adalnlatntlon 
lore favorably than did the graduetee theieelvee. In eech of the five 
apeclfic dlienelone,^ ee well ee In "Overall Frepentlon/' the lean ecoree 
for the euperlore* percaptloni were higher than thoae of the gredmtea (aee 
Table 2). 

The ''Overall Prepention In School Adiiniatratlon" wee reted rather 
favorably by the graduetee end by their euperlore (leane of 3.84 end 4.21 
teepectlvely on a J-poiot ftale). Greduetee eew Steff Feteoonel ee the 
atrongeet aree of preparation, and Buelneee HiOagaBeDt ee the weekeet 
(4.07 end 2.B3)« llielr euperlore tended to egree (A.33 end 3,62), although 
they eleo eaw Student Feraoonel ee e very atrong area (4.34). 

Teble 3 nlnforcee the ebove flndinge. Slity-elght percent of the 
gnduatea and B6 percent of their euperlore nted the Overell PreparetloD 
in School Adiinletntlon ea "4" or better oq the 5-point ecele. In the 
aree of Bualneaa HMegewnt, only 35 percent of the reaponding graduitea 
' and 52 percent of their auperlon Indlceted e T or better* The lergeat 
diacrepency eppeered in the era of Student Fereonnel, where 41 percent of 
\ the graduetee, but 89 percent of their auperlora, indicated "4" or higher, 
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\ ^The five ireie of edalniitntlve pcrfonance auneyed wen Inatructlonil 
Prdgras, Student Pereonnel, Snff Fereonnel, School Cotawnity Relatione, end 
/ Buiiiieaa Hinegeient, 



Cotftti by leipondenti 

Thi lilt itn on thi it^mi ihiiti Invltid comnti or iugg6itloi\i 
ri|irdlQ| thi Hiitar*i Progrw in School Adrinlitritlon. Only thru of thi 
tvtaty-nlni lupitlori iMpondlng Included luch coiiapti, tnd ttiilt copenti 
viii not pirtlculitly hilpful lot prograi iviluition* Criduitei^ on the 
other hind, provided »uch lori uiibU ioforutlooi Thirteen of the tvinty- 
tvo iriduitee reepond^l vroti conente deellng vlth overell eveluetlon 
of the Heetei'e Progm^ with perccptlone of pertlcuhr Inetructore, or 
with thoughtful euggiitlone for progrn liprovcKnt, which they offered 
in the light of their experience on the Jobi 
8ico—nJittcne 

The Mjcr condueion of thie etudy vei thet graduetee end their euperiore 
in the public echoole hid e generelly fevoreble perception of the quellty of 
the Miiter'e Progreii end ite eblllty to prepere perticipente for poiitloni 
in educitionil edilnletretion. Preperetioa In the irei of Bteff Pereonnel 
(Includinl rKruitMDt end eelection. Bupervliion» eveluetlon^ and piofeeeion- 
il davelopiert) vae perceived to be pirticulerly etrong. 

Severil reco^nditione ere luggiited by the reiulte of thii etudyi 
L AddJtiooel work in progwi orgenlietlon, curricului developatnt, 
end progrei mloitlon would b« deeirabU. Sow of thie content dght be 
•ble to be Incorporeted in Elewntary end Seconder^ Ad«inietretJon coureia. 
In addition, alectivea euch ee Educetion Eveluetlon end Inoovetion and 
Advenced Curricului night ba built into the Progrii of Studiea of lora 
Btudante* 

2. A hitivier epphiiie on ereae of Buelneia Minagewnt should be lade 
a part of tbii Haiter'a Progrw. Agein, iore work In thie area ilght be 



done In couriei currently teught. Another poiilbilUy la to require 
epedflc bualneae lanageaent readlnga and projecti as part of field work 
in school adainiitratlDn. 

3, A self-etudy nodule on conunlty resources should be developed 
to enable Addnlstrstlon students to learn aora ebout this area, perhepa aa 
a project In one of the required couraei. 

Hore work in the area of stress Mnageaent end conflict resolution 
should be incorporsted into the Master's Progrsa in School Adilnlitratlon. 

J. The eeaignaent of a aelected list of aeiinal worka In educational 
adiioiatretion end related areai ai required reading in eiiating coureee 
should be cooaideredi 

(fork on the iipleoentation of a nuaber of these reconaendatlone le 

currently In progreee. 

Conclusloa 

The ittdel for eveluetlon described in this paper could be employed 
. by ediinietratora of other MSter'e prograna aa a coaponent of their 
aaseaiaent efforta* The Bodel'e two diaensions provide velueble coapar- 
atlve data while protecting the prlvecy rlghta of reipondenta. 
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Append li A 



T«ble 1 

AIHINISTBATIVI POSITIONS OF FIOfiRAH CRADUATKS 
(II-33) 



llfiHDtiirY School Prlnclpili 


5 




Bicogdirj Ichul rtlnelpili 


5 




UtMitoty Aiilitiot Prlnclpili 


2 




Sicondacy Aiilitint PrlDclpili 


18 




SupatvlHori/Coordliitiiri 


3 




libit 2 






COKPAIIISON OF PEECIPTIOIIS OF CIADUAISS AND SUFKIIORS 




vamm adhinisihative prepamtioii ih various areas 




(Ktin Scorn) 








Griduitei 


Supirlora 


Arm 


(K-22) 


(N.29) 


laitTuctloul ftoira 


3.39 


4.07 


Itudant Pirionnil 


3.36 


4.34 


Stiff Purioanil 


t.07 


H.J J 


School CoMinlty Rilitloni 


3.79 


4.11 


luilniiH KitiaiiMiit 


2.83 


3.62 


OveiiU Prepiritioo 


3.84 


4.21 


Tibli 3 






PERCEMTAGE OF EESPONDEHTS RANHHG "V OR 




ABOVE ON A FIVE-POINT SCALE 




Areii 


Graduitei 


Suparlori 


hitnictloDtl Pcoirii 


50 


74 


ttudiot Pirionnel 


41 


89 
92 


Stiff Piirionntl 


68 


School Conunlty RtUtloni 


52 


75 


ludneu HnageMot 


35 


52 


Ovarii! FrtpiciClOD 


68 


86 
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LETTERS TO GRADUATES AND THEIR SUPERIORS 

i 

Dair GriduBtfll 

Ue an conducting in iviluitlon itudj of our KBiter'i Progrn in School 
AdnlnlitritloQ hari it CSli CoUigi of Educitlon. To help ui iccoMpliih 
thU goili VI in iiklni thou of our griduitei vho in currently holding 
idnlnlitritlvi poiltloni to conpUti tho ittiched quiitlonnilre. 

h order to get id iddltlonil pirepictlvi» va plin to lend i ilillir 
queitlonnilri to the ichool lyitn iiklog thet the Superintendent^ or 
inothir one of thi gnduita'i iupervlion» ilio evaluite our HaiterU 
progru on the bull pf eiparlanci vlth one of Iti gcaduatea. Of courier 
nsMB of lodivlduili or ichool lyiteii vlU not be uied In analytlng or 
reporting the date. Tba purpoii of the itudy ia to provide ui Infonitlon 
for prograi davalopNnt la varrinted. 

If you would prefer that va not iill tha queitlon to your echool lyitei, 
pleiia elgo end nil the eocloied cird ao thit It reechee ly office by 

I hope that you will partldpete In thle etudy, end I think 

you for bilping ui iviluati our Frogrei. 

Sincerely^ 



Dear Superlntendinti 

Va would epprecleta youc help In our efforta to aveluate the Kieter'a 
Frogrei in School Adilnlatntlon hen at the CSU College of Educetlon. 

The peraon naied below le e greduata of thla Progrn^ and, according 
to our racorde, la eiployad by your echool eyitai In an ediln.iitntlva 
poiltlon. Ha would bi gritaful If you would complete tha attached 
fon evaluating the Prograi, or peaa It on to one of the pereon'a luper- 
vlion for coiplatlon. 

Ue have eiked tha Prograi gradueta to coiplete a elillar quaitlonnilre, 
end we have obtained hle/har coopintlon In pewltllng ui to eend you 
thla onei Of courie. naeiee of lodlvlduala or achool eyateia will not 
be used In analyilng or reporting the data. Thank you for your 
aaalatance In tha evaluetlon of our Heeter'e Fcograi. 

Sincerely, 



1i o 



Appindlx B 



RESrctlSE CAJIO FOR CRADUATEfl 



Dfltii 



Dipirtunt Chiitpiriont 

I vould ptifir thit thi Progrw Evaluitloo .luiitlonnalre 

MDCloned In your letter of 

•chool tliM, 



not be Bent to ly 



Signed^ 



School Syeteii^ 



Umm 6HKET(011ADUATK) 

Qneil on your id«lnlitritlvi eipirUrtce. elnce co«pIetlnR vork In the Pro|^^^ 
pliiii live yaur'eviluitlon of the CSU CoUm of Ktotloii Hnter ■ Prog ii 
In School Ad^lnlitretlon In eich of thi follovlng iriai. tf you hivi no bieli 
for eviluitlon on my Iteni circle the NB, 

1, Prepirition in the irei of Initructlonel Progria (including eoch ir 

prograi orginiietion, currlculu» divelopwentp progrm iviluatlon), 

II uiik ^ Hodeiate ' Strong 

Dull 

2. Ptepitatlon In the itii of Student Perionnel (Inckdlnj inch »r«i. >■ 
dliclpUne, juldinca, itudint Inforutlon md tecordi). 

H, 1 2 3 « 5 

„„„ Hod.r.t. 

Bull 

3 Fripiritlon In thi irii ol Stiff Pitionnel (Including luch it.ii tectult- 
IS JId ilhctlon. ..pitvlilon. .v.k.tlon. profeiilon.l d.v.lop«nt). 

„, 1 2 3 4 5 

I • Hodirit. Strong 

lull 

with coBiunity nenbcre). 

I J;;;- ' ^^i!;;;""""'"'"""" strong 

Bull 

5 Preoititlon h the iru nl 8>..1^«» Hani»e»ent (Including »uch ■».• u 

5. '^X;;,,,^^ ,.pu.l-u?— ^T^«rvl«. tr.nBport.tlon). 

i;;r ' 

Bull 

6. Overill prepititlon In School Adilnlitritlon. 

^ • 

cogent, or ..ggeitlonirigirdlng the CSUHiiter'sProgra. in School 
Wilnlitritlon (continue on bick, It desired). 
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Appiilillii II 



ttaigiayiitt T (mum) 

Uui on >our knot<liil|i o< thi id.liiUtriHvi pirlotunci ot Jii p.rion 
nml on thi «yit ihut, pUmi |lvi your ivilu.tlon ol th' iSLSaiiU! 
.1 Muctlonlteititi Pr Y" Milnlitritlop. In iich of hi oUo« 

ini mil. 11 you iiivi no biiti foe iviluitlon on my Im. 8l"li thi NB. 

I. rripititl')n In thi irii of lutmtlonil ftoitij (Includlni luch inii ii 
proftn otiinljitlon, currlculun dmilopBint, proitu iviluition). 

I i;;* ' Hodiliti !"">"i 

lull 

J. ftipiutljn In thi irii of Studint Utionnil (IncUdini luch iiiai •• 
dlidpUni. luldinci, itudint inforaition ind ticotdi). 



HI 1 

No Uiik 
lull 







Hodiriti 



—J 
Stioni 



J. Pcpiriclon in tb. «« of Stiff P.t.onn.l. (includlnj 

Z ind ..lictlon, .up.tvl.lon, iv.lu.tlon. ptof...lon.I divilopwnt). 



NB I — 
No U..li 
BuU 



Hodiriti 



—5 
Sttoni 



i Fr.p.r.(ion In th. .ri. of Srhnol CoiunltT motion. (Includlnj .uch .ri.. .• 
SSonl. i;t.rpr.tln-,co«unlt,.ttltudi., building tilitlonihip. 

with coMunlty Kiib.c.). 



m 1 — 

No V«.li 
lull 
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Hodir.te 



,...5 
Strong 



^ rnniritlon In tM ir« of toilnm Min.nwilt (Including .uch «e.5 li 
IK Iudi'trn;. ciplt.lT.provLti:food..rvlc.. tr.nsporctlon). 



NB I — 
No 

Bull 



.-3---- 5 

Hoderite Sttong 



6. OviriU preparitloft In School Addnlitritlon. 

m ' ''''''' 

h Comm or -uggestiom rei.rdlng the CSU H-ster'i Progra. In School 
Adilnlitcitlon (contlnui on back. If desired). 



m\\ mmim mmmi mm m) iiHriiiYiiii mma 
IN 1)111 mwmm 011 nmmmi mm \wm\ mmm 

Dunlel I Hall 
Trenton State (!allB|e 



Introdimtlon 

l>ri)foi!il{]iiiil iuiter de|rooi cniistltuto u grnwl(i|t najorlty of ull mistor 
ilegroei uidArded eniniilly In thli country. (!] Ilie iro^lni lioodi nf goveinMont (it 
•II levels mil biiiliiesaes for Urge nuibera of coipetent ilddle and ii|i|)ar level 
lanagflient perioni and other service speclallsti have boon addressed In part by 
colleges and universities via the professional lasters degrees, Nhlch usually 
range froi thirty to sixty seiester hours of course work and related requlreaients. 
Hie degree recipients lay be, for exaiplej a supervisor or lanager In a hospital, 
lunlcipal, state, or federal govemunt office or agency Norkers; In business, 
education, social work, or as public librarian or an art therapist. Hiese Indi- 
viduals' preservice and in-service education have becoie an liportant growing lajor 
part of our graduate education whether on a part-tlie, full-tiM, traditional, or 
non*traditlonal basis. 

The Qpndbnaed' paper is directed at encouraging and Ivprovlng assessient Input 
froi the graduates and their eiployeri. lt\e in-depth assesssent by users of our 
prograRS and "products*' seeis often to have been given little attention In the 
past. Every day ve as consuiers evaluate the products and services we use; and 
■est eiployers periodically review their eaployces qualities and perfonances for 
proiotlon, developient, reasslgnient, teralnatlon, etc. Colleges and universities 
MJSt at least periodically review and lake Judgments about their professional pro- 
grai efforts and ''products" In order to have thei relevant and coipetent. 

ARong various aspects covered in this paper are: (I] the use of exit inter* 
views with graduates (particularly), (2) the nature of questionnaires and Inter- 
vi^ follow-up of aluani and selected eiployers, (3) the desirability of an Insti- 
tutional assesssent cy::le such as five years (illustrated by Trenton State College 
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pnctiu) Nhlili l» |iirt of cti»tlninl m\m\\m \\Mm* (<) 
llci of iwch iwcciiiifiil rovloM mxm (A| t»i|) ntaliil»initlvfi »ii|»|»iirl 

(luck It iMilirihlp, pliiinlni, fliuncei), (B| UWmiWi imxHtii wJlviiHiiii mi 
pirtlclpitlon, iihI ((!| rlifl nature nf the cvuhmtlvt) \m)mm mA piocoiliirflii, Ilia 
luthor liai M pflriiuiiil B)i|)«rlijiK«i In ilio mtmm milvlilwi illinhinnl In iIiIb 
fipir II I profaiior mil iciileilc nlilnlHliMloi. 

I. tile of llxlt IntorvUMi with (iruJiiHtei 

hii liilirvlewi with iriiliiito itiidonti Just prior to or IPcJlatily iftor 
receipt of their Miteri degree ire partlcuUrly li|iortint to progru isseisieiU 
of flutcoiei pirtlciiUrly ii they affect the itudents, Such interviews with the 
UN iridiiate cm readily relate to an Identifiable prograi and provides the op- 
portunity to lecure feed-bick Infomation froi iM student!, One ideil tiw for 
I group interview between the to-be-iraduates ind the graduito ficulty would be 
Qlir the end of the sewitor in the required or last culiinatlng course. Hils 
group Interview would not replice individual interviews by the graduate faculty. 

Frequently In the individual exit interview or conference the faculty-graduate 
student leUtlomhlp encourages discussion of future career goils and the willing- 
neii of graduates to respond froi tiie to tiia froi the field about personal pro- 
fessional In-servlCB needs and Job needs of the organization, Such inforutlon 
lay appear to have relevan(^e for continuing education; occasionally, it could af- 
fect the present prograi. Tlie positive personal-professional relationship of fac- 
ulty and graduate can produce i continual supply of new students (enrollients) and 
issessient Inforiation (that is if the graduate will continue to keep the depart- 
wnt up to date is to address and/or position). 

n. Use of Questionnaires and Interview Follow*up of Alumi and 
Selected Eiployees 

On the use of questionnaires to aluml of the graduate prograi. there should 
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lii^ niitilileritlloi) given lo \\mim ^ho \\m \m\ m) tm ilin imigiiii f\}\ 
Miiiiy (iiiih Ml ovev tlve yoavO m\ \\\m \)mmi m mm\ tu\\m\n 
11 lo rive ye«ri|< I'eriinia rocelvlng (he DMnniiDdDt iHUiwiii for ik 
(l)lrd or Kire tlie ihoiild lie M wm Hhimt \m their pnnltloii i(>i|i)l)'i)Mi)iili (rni' 
lititmirlni) \\m liiiiiigtiil, li)riousml, lud/uv tiuiiilfti m\ wmU. h\\\i\\\i ii liii|t) \m 
mi of tliBso eirl)* ilnml ire great illiUncei froii m\m\ \\m ilmlr wrhlen cui^ 
Miiiti/ndvUe can give lore than Juit a local or regloiiul vUw, 

One iitcieiiful ipprouch In beginning m uisasmeiit with (ho iihimiil li U\ have 
thei eVHhiuie the intent tint the lajor objectives of each nf the ro(|ulred and mat 
eiirulled'li) elective couraei ami experlcncesi such as InternHhipii, practlcuii^ and 
cooperative arraiigeients have been achlevedi For exaiple, the graihiate prograi at 

Trenton State College which la currently being reviewed (Including an out-of-state 

II 

consultant visitation In lite March) li that of a Oevelopiental (loading Prograi. 
Hie prograi was fonulated over five years ago using the international Reading 
Association standards and interpretations within the courses, experiences, and 
procedures. Appendix t (three pages) Illustrates how the graduate faculty of that 
departient undertook the review (asseisiont) of the lajor objectives of specific 
courses (please note that the three pages are a fan of the total instriient), 
Hie total questionnaire was sent to all sixty graduates; thirty-nlne responded by 
the Initial review of responses, All graduates were eiployed when they undertook 
the prograi, and the saie requireient exists for current students since it Is an 
in-service prograi for part^tiie students. (See footnote 2 regarding part-tlio 
graduate enrol lient in the United States for the 1979 fall seiester.) 

After receiving the questionnaire responses and interpreting thei, the gradu- 
ate supervisor (faculty lodber) of the prograi reviewed thei and other related 
Iteis with alumi where possible in a three-state area (New York, Pennsylvania, 
and New Jersey) on an individual or siall group basis. Nhere three or lore grad- 
uates were eiployed by the saie school systei, the graduate supervisor holds a 
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CMfmki Mitk thoir superviior to discuss thit IndlvlduU's concapt'and evilua- 
tlofl of the profTiD IS well is desired changes or eiph^K^'luch recouenditlons 
iri rtvletied by the departientil faculty and ire coni'atned In the.wrltten report 
prepared for the out-of*state consultant. 

Ihi Intervien (in depth) vlth aluwl In the field and Nlth eiployers consti- 
tute tha lost viable anilyiis and feed-back for the present and future prograis, 
fiiici aluHii of thf current prograi are In lany different school systeis and 

Mually there is not threi graduates eiployed In each systei, consideration Is 

■ .>' ' 
Nlng flveii by the departient to requesting the eq)loyee and the school supehlslir 

to jointly coMnt Ibout the prograi, its content, procedures) reeources, andiuture 

Midi of the school ^ystei relative to the progra. A supervised practlcui'ls jirt 

of the present progrii ta that frequently discussion of these Iteis by the |ri({uate 

faoiUy'iuperirlilng the practicua occurs Jurlng the seiester. Legally obtained 

eiplayee feed-back la^ler^the earlier aentioned procedures has provided valgAble 

liilitiAce In progrridevelapient. 

in. AliMl and Eiployer Input as Coiponent of Cycle Assessient ProCeis 
ttilh the use -)f exit Intervlei^ of persons to be graduated takes place each 
leaester, graduate Institutions should plan an Intemil cyclical arrangeient to 
revlitf their prograns. For exaiple, approxliately one^fifth of the graduate pro- 
gran at Tranton Clate College are fortally reviewed by the respective departients 
aid college adilnlstratton with out-of-state consultants who are approved by the 
Niv Jersey Departient of Higher Education. These fortal revlevs are in addition 
to the Hiddle States Assoclation(MSA)and special. groups such as National Council 
for Accreditation r.t' Teacher Education (NCATB), National Association of Schools of 
Mtslc; hvtrever, assMsient of other activity during the particular year scheduled 
tor reaccreditatlor of the first two groups (19S4-8S) will be directed toward those 

0 

aifociitlons' requlreients. Ue input by eiployers via interviews has been mi 
helpful In review of prograi objectives and possible changes. Both HSA and NCATE 



include (expect] such feed-back infonation under specific standards. Hius the 
Graduate Office and the departiental faculty have the benefit of or(anlzed altunl 
and selected eiployer feed-back at least three tlies every ten years'^ twice via 
the internal review process and once for the reaccredltlon review. 

IV. Soie Additional Hajor Characteristics of Successful Assessient 
Prograis 

Along the lajor characteristics which have enhanced the success aiid accepta- 
bility to faculty of these review efforts have been the fallowing: (A) top adiln^ 
istratlve sjpport for the process,, (B) internally generated lodlvatlon and partici- 
pation, and (C) the cooperative nature of the evaluative processes and procedures. 

Adilnistrative support froi the President's office to the Dean and Chairperson 
level is necessary and usually vital to the outcoies. Nllllngness to provide 
finances for outstanding consultants, for conducting the Internal reviews (such as 
travel costs for interviews, tabulating resultSi recall of Institutional data, and 
the institutional research office coiponent staff tlie) provide the graduate faculty 
and the Criduate Dean's office with basic supporting services. 

Intenally generated review prograis utiliiing all affected persons (students, \ 
aluwl, faculty, adilnistrators, eiployirs) provide an environient for prograi 
developient (and liproveient). By the graduate cosmnlty undertaking Its own 
organized reviews with agreed upon expert consultants and un.der a cliiate not re^ 
quiring accreditation or reaccreditation, the changes (and professional responsible^ 
Itles) for objective, constructive, and confinatlve recomendatlons are excellent. 

Hie need to have faculty and adilnistrative acceptance of the procedures 
and process is essential. Ihe adilnistrative aspect h,<*<; already been noted. The 
process of developing an evaluation systeis miwcihf^^ evaluation, and working 
to effect the recowended steps for further enhanceienl ^7 the prograi is a coopera- 
tive endeavor of the faculty and adiinistration. Dressel notes: 

Evaluation done with or for those Involved in a prograi is psychologically 
lore acceptable than evaluation done to thei. When doubts already exist. 
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Mhtn deciiloni are pen<lln|» ind tdien concrete evidence Is truly desired, 
the eviluetor (tins ireiter cooperation and finds a reidlness to study 
and act i^on findings. Evaluation carried out In this context usually 
brings gradual rather than radical change and li, accordingly, wch less 
threatening, In fact^ lost change In education Is increiental rather 
than radlcili and advertising of this fact would liprove the cliiute for 
evaluation. (J) 



A Concluding Note 

Regular, organized efforts by graduate Institutions to secure valid enployer 
and aluvi responses (assessients and ideas for changes in prograis to leet m 
requireients) via personal Interviews lay ippear tiie consuilng for faculty in- 
volved, lut wst faculty have been lore receptive to this feed-back for needed 
changes than any other local source. Internally generated progrii reviews 
cooperatively done enhance the chances that the increiental changes will not have 
to valt for ten years or longer under the accreditation process. The siall addi- 
tlonal annual cost will lake lore likely vigorousi relevant prograis. 



\ 
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1. Tlie following Inforaatlon regirdlng wjor selective fields in which lastfcrs 
degrees werejwarded nationally froi 1972 to 1976 is froi the National CentV 
for Educational Statistics data: 



FUlds 


1972 


|973 


1974 


1975 


1976 


CQUtlllUII 

Business 
Public Affairs 
lleilth Professions 


9B,]00 
30,500 
9,600 
7,400 


105,600 
31,200 
11,200 
1,500 


112,700 
32,800 
12,700 
9,700 


120,200 
36,500 
15,500 
10,800 


128,400 
42,700 
17,300 
12,700 


Enilneerlng 
Psychology 


17,000 
5,300 


16,600 
5,900 


15,400 
6,600 


15,400 
1,100 


16,400 
7,900 


Social Sciences 
Letters 

Physici'l Sciences 
Blolo|lcil Sciences 
Hatheutlcs 


17,500 
12,800 
6,300 
6,100 
5,200 


17,400 
12,400 
6,300 
6,300 
5,000 


17,300 
12,200 
6,100 
6,600 
4,800 


16,900 
11,900 
5,800 
6,600 
■ 4,100 


15,900 
U,40D 
5,500 
6,600 
3,900 



2. The "Report on the Council of Graduate Schools-Graduate Record Exailnatlons 
Board 1978-79 Survey of Graduate Enrollients" by Bernard V. Khoury, Prograi 
Director, GRE, Educational Testlnj Services dated Noveiber 29, 1978 reports 
In Table 6, page 10 that on the basis of 78* of the CCS institutions "which 
accounted for appropriately 75* of the \W total student enrolliont of CGS 
institutions" il\ of graduate students at its leiber institutions where the 
laster's degree Is the highest awarded degree are part-tlie ; at the leiber 
doctoral degree institutions the percent for all higher degrees it is 53V 

J. Paul L. Dressel, Handbook of Acadeiic Evaluation , San Francisco: 
Jossey - Bass, 1976. p. 5 



Cr;(]uite Developmental Reading 
Progri^Qucat^onnalre-Part II, (cont'd,) 



APPENDIX I 

TREKTON STATE COLLEGE 
. Trenton, New Jeriej 

GRADUATE DEVEUPWinAL READING PROGRAM qUCSriONHAIRE 
Firt Us ReidlQg Progiii Eviluitlon 



Ai Griduiti DtvilopM^ktil Reidlng Progru wii diil|Did to dive lop 
UAdiiitindlDii, kiKMlidgeii conctpti, ittitudeii lod ikllli thit would 
lAibli I pirioQ to if COM 1 develbpofotil reidlni ipicliUit. Certiln 
o( tbi cipiblUtiii viri Miiured through ixialnitloiii, piperi, end 
riidlngi; oehirN veri perfoninci oriented and eviluited In pricClce 
iftd iiilnir ilttiatlonii itlU otberi were Miiurid through lirge end 
mil group diicuiiloQi* 

Pliiii riid the ititeoenti below end iviluiti the iffectlveniii of 
thi profeiiloQil lequanci of jour griduiti developMRtil reeding progrvs. 

Dei thi follovlDg leali to riti all ititiMotu 



1- Outitiodlng 
1* Abc'Vi Averigi 
3" Adrquici 



4- lelov Avirigi 

5- iDideqtiiti 

6- Not AppUcibli/UnknovB 



A» Ibi couriii. In tha griduiti devilopaintil riidlng progrii hilpid u to: 

1. Dndiritind thi plici of lingui|i in i culturil lyitiM. 

2« Undiritiod tboii llngulitic prindplii thit hivi riUvince 
for thi riidlng progru, linguigi li btfilc to riidlng 

InitructloQ. 2._ 

3. Anilyii ipaech for identtficitloo of devilopMntil linguige 
pittirtti and for dlilictlcil pittimi. 

4. UtlUii Unguiitlc and piychologlcil ptlDclplai in plinning 

for reidiog ioitruction ind In eveluating iDitnictionil Mteriela.4.^ 

y Undaritend the perceptuel, pbyaiologicll^ end pijchologicel 

bieei ee veil ee lociologicel influencee of connunicatloa. S.^ 

6. Underiteod tha contribution! of phooology end lorphology to 

tha decoding ekilli. 6.^ 

7. Underiteod the reletionihip bccvaen tha lorphaile end 

lyntictic itructura of language and tha conpreheniion ekilli. 7,^ 



B. Apply significant reieerch flndlngi to the teaching of reading In order 
e. Identify methodi appropriate to Inatnictlon 

b. lelact appropriate oiaterlale 

c. develop conpreheniion ikllla/ebllitlei 

d. develop decoding iklUi 

9. Apply the ikille needed to: 

e. develop objectivea for a lequantial reeding progrea 

b. aelect materleli appropriate to the niedi of IndlvldusU 

c, eilect Mthodi of Inetnictloo appropriete to the needs 
of Individuile 

iiaaee and/or avaloata tha reiulta of initniction 

10. Develop aklll in the: 

e. ednlnietrition of dlegnoitlc initnannte 

b. interpretation. of dU|naitic reauUr. 

c. aelection and utlUiation of Mterlale end wthodi baaed 
upon the reaulta of tha diegnoeia, 

11. Apply crlterle end techniquea for analyzing current approechee 
to tha teeching of reeding. 

12. Apply crlterle and techniques for evaluating Diteriela for use 
in e echool lyatci. 

13. Apply baaic prlndplei of reading to claiarooa Initniction. 

14. Anilyw ind eviluati Initructlonal procadurea used in e cliiitooa 

15. Eviluita pupil progreae in reading. 

B. Evaluate tha following end continue to uie the acele ebove: 

1. Prectlcun end Senlnit 

2. biboratory Experience in Teatlog 

• 3. Supervision by College Superviaore 
. 4. Inatructlon Received in tour Total Progran 
5. Advisewnt Received in Tour Progrea 



to: 

8»e._ 

B.d.^ 

9.b.^ 

9. d.^ 

10. e.^ 

lO.b.^ 

lO.c.^ 
IS. 



I. 

2. " 

3. " 

4. " 
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Craduiti Devitopurtil Reidlng 
?ri|ru QvMitlonniln^Firt n»(cont^d.) 



C. Whit do you conilder t» t itrengthi of the Graduate Developwotil Reading 
Progrii to bel Pleait uie the ipice pcovided for your aniver. 



CRITERION REFERENCED EVALUATION OF A 
RASTER'S IN BUSINESS ADHINISTRATION PROGRAM 

Donald U. Fogarty 
Arthur E. Hoover 
ind 

Ullllaa J. VhltDore 
Southern Illlitola IlDlverslty-Edvardsvllla 



D. Vhat recomndadona would you oike that would itrengthen thi Graduate 
Deiilopflental Raiding Program? Pleaia uia tha apaca provided for your aniwer. 



For aeveral yeara the School of Buslnegfi at thU Unlvetelty hae offered 
an H.B.A. degree. During thia the, aeveral atudlea of the effectiveneBi of 
this prograa have been conducted (3, 6, 7], The prlaaty llaitationa of theie 
Btudiea had been that eithari (1) the effectiveneie criterion of the progran 
V8I the graduate grade point average of the itudente [3, 6]; or (2) when 
another efCectlveneei criterion had been uaed, the atudy wai Italted to only 
a part of the prograa [7]. 

The purpoae of the current criterion referenced evaluation prograa vaa 
to develop a procedure that would aeaaure the effectlveneaa of the total 
M.B.A. prograa with a criterion variable eeperate froa achieved graduate grade 
point average. The purpoae of thli paper la to diacrlbe the procedure that 
haa bean developed and to dlacuaa loae of the prellalnary findings of thla 
evaluation proceaa. 

Structure of the HJ.A. Prograa 
Tha H.B.A. la a aultl-diaclpllnary graduate prograa in bualneaa. The 
prograa at Southern IlUnoia Unlveralty-EdwardavlUe conalats of 20 couraei. 
Fifteen of thaaa couraes are required of all atudenta and 5 are alectivea. . 
Bight of tli;. 15 required couraeD are dealgnated ai the "Foundation Couraea" 
end uaudlly are taken In the flrat yiar of the prograa. The reaalnlng 7 
required couraea are dealgnatad aa "Advanced Couraea" and are taken In tha 
second year of the prograa. The 5 electl e couraea noraally are taken In 

1 



thank you for your cooperation and help In thla wdeavor. 
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thi iicond year of the prograi lod cn be couries tiught by my of the 
depirtMnti In tha School of fiualneei. This progra* la offered In both a 
Mik-nlgbt and a weekend fonat. 

Tha r ^red couraea art taught by flvi different departtenta. The 
dapartMDta and tha nuibar of couraea taught by each are) (1) Accounting 
and rinance^-4 couraea; (2) Econoiilce-2 coureeai (3) Hanageient-A couraea; 
(M Kanageunt Syateia-3 couraas; and (3) Harketing-2 coureea. The K.B.A. 
Frogra* Director la raaponalbla for coordinating and directing thla prograi. 
Tha Frograi Director reporta to the Dean of the School of Buelneae. It ahould 
be noted that i/hUe tha Prograa Director doea have reaponslbUlty for the 
N.I.At degree, feculty leibera hold rank and ttnure in one of the five dsp&rtzcnts 
hated above. Thla, then, la not the soet dealrable organizational arrangeisent 
in vhleh to corduct an extanalve prograi evaluation. 

THS eVAlUATIOH PROCEDURE 

The baalc daalgQ of the evaluation procedure la a Fra-Teet, Fost-Teat, 
Control Croup dealgn (2]. The experimental group la the veekend forut while 
the control group conaiata of the ueek*nlght forut* Both tha pre-teat and 
tha poet-teat are criterion referenced exailnatlone |}|. 

In order to develop the criterion referenced exailnatlona^ a conon 
courae eyllabua vaa generated for each required H.BiA. couraei A bank of 
lultlple choice queltlone then uaa created for each courae. Theae questions 
vera kaytd to v-uloua aectlona of the conon outline. All of these taeka were 
conducted by groupa of faculty aeibera who noniilly taught each course. 

Theae queailona were reviewed and edited In order to eliilnate any 
obvloua Inconalntenclea. They, then, vete lte4-valldaCed by adilnlaterlng 
thii to a croaa -section of atudenta In both the weekend and week-night progren 
fonata» Bach of the questions waa analyzed by leans of blaerlal correlatlona 



and the results were dlaienlnated to the various faculty iKobers who had 
subnltted the Itess Those questions with a positive blaerial of .25 
or greater were retained In the question bank, r^d those below that value 
were returned for revision and aufaaequent revalidation. 

The pre-teat and post-test were drawn tm the question bank In the 
proportions apedfied by the faculty groups. The pre-teet (diagnostic) la 
adiinlatered to atudenta aa they enter the progras. Approxkately every 
alx Qontha after thUi atudenta are given a poat-teat for each courae taken 
during that alx lontha. In order to successfully complete the prograi^ 
students not only sust receive a paaaing grade In each course but alao m*.at 
Vbi*' Che poat-teat (coiprehenalve) for that course. The adoilnlatrBtlon of 
these exaiinatlooa la outaide of claas tine and la conducted by a apeclal ataff 
not associated with the teaching o( th^, courses. 

When the exaalnationa have been coapleted and scored, the reeulta are 
distributed to the atudenta. Theae are reported aa "hlgh-paaa,^^ '^pasa," 
*'lov-pasa," or "fail" acorea. Suioary data also are distributed that perait 
atudenta to know how well each courae aection did In coiparlson with the 
overall perfonanca on each aerlea of poat-teata. 

rindlnga of the Study 
Thla study la still continuing, and these flndinga ahoald be conaidered 
as prellihary findings. The evaluation procedure hai had a rather aubatantial 
lopact on both students snd fsculty. Students have becone quite Interested 
not only In what the instructor teschea, but also in the material contained 
In the connon outlines. Whenever there la aubatantial deviation between the 
fliaterlal in a clasa and the iaterlal in the cosnon outline, the atudenta are 
quick to conplaln. Nhen the evaluation prograa was first introduced, there 
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were mm codphlnti reglitered by the itudenti ibout the testing progria 
II I whole. 'After the first ahock wive of coApliinti lubaidedi however, 
lubiequent coB|»lilnti have becoie inetructor relited rather than evaluation 
related. 

Faculty Muibere hive becone lore Interested 1q ^he evaluation procesa 
and luch lore Intereated In participating la the design of the couraea and 
conon outUneb. ' Faculty leibers also have becou Intereated la the evaluation 
proceia aa a scurce of data that could result Id publlcatlona for then. 
lipact on Adaltalon Criteria 

Adelaaloni to the progran have been baaed prltaarlly upon the '^foruula" 
ipeclflcd by the Aierlcan Aasenbly of Collegiate Schools of Business (AACSB). 
Ibis fonula la: P"|(200) (U)| + C, where F * Folnts, U ■ Undergraduate Grade 
Point Average, and G - Graduate Hanageaent Adilaalons Test score |1). Tbe 
previous studies of the prograi Indicated that the Undergraduate Grade Point 
Average (U) had not been eapeclaUy effective in predicting Graduate Grade 
Point Average |2, 

Tha current data conflti these findings and further Indicate that 
Undergraduate Grade Point Average is not an effective predictor of perfonance 
on the criterloQ referenced exaalnatlona either, It thua appears that the 
AACSB fomula l! too heavily weighted toward the U coiponent and that an 
liproved forwli Is needed. There also Is soae indlcstlon that the nature of 
the undergraduate najor could be used aa an additional predictor of performance 
In the N.B.A. prograi. 
le pact on Instructional Fonaats 

One of the prlaary objectives of the evslustlon program Is to coipare the 
weekend and week-night foriuts. At the present tlie, there are not enough 



observations in both of these groups to draw even prallmlnary findings. 
Data have been collected, however, that provide certain useful Information 
about the two formats, e.g., the grades in the weekend format are',>ilgher 
than In the veek-nlght format. 

Another factor that Is sppsrent from the available data is that the 
"difficult" courses In the prograi are difficult in both the weekend and 
the week-night formats. There Is sow Indication, also, that the "instructor" 
has a substantial Impact on the auccess of students on the criterion refer- 
enced examlnatlona. It does not appear, however, that faculty aembers who 
previously have been considered "effective" are always aaaoclated with high 
achievement on the comprehensive examinations. 
Impact on Individual Courses 

Some snalysls has been completed on the criterion scorea in each of 
the foundation courses (eight, first year required courses). This indlcstee 
that, in general, the predictors for the overall program hold for each of 
the foundation courses. When there is variation. It is In logicsl direction 
(In the highly quantitstivo courses, the quantitative component of the GHAT 
Is a better predictor than the overall GHAT acore). 

Future data analysis will include a comparison of the performance In 
each of the major "outline" components of esch course, This statistical 
analysis will permit a determination of tbe difficult areas in each course 
when key variables are held constsnt. This should assist tbe faculty In 
selecting pedagogical techniques which better achieve their stated objectives. 
Impact on Instructor Evaluation 

The program evaluation procedure will provide some additional input that 
can be used in mtusurlng the effectiveness of various faculty wmbcrs. Aa 
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thll diti li hititd 00 the criterion refereoced eiialnAtloDa, it vlU have 
I hl|htr degree of rilliblUty than that which li nomllj available from 
aourcea auch a« ajUabua aoalyilai itudent avaluatlona, and claaarooa 
vlaltatlone. It le not expected, however, that this data vlll be the only 
liana of avaiuatlni teaching effectiveneaa, or even that It should be the 
Mat liportaot leana of evaluating teaching effectlveneea* It la expected 
that vhan theat data are available, the perceived efttctlvanesa level of 
faculty leMbera vlll be Increaaed nore often than decreased. 

Parhapa even lore liportant, the evaluation procedure can be uaed to 
aailat Individual faculty leibBra in identifying problei areaa of inatructlon. ^ 
Aa an axupla, if a faculty leiber'a atudenti ari having difficulty with the 
"legal environiant'* coiponent of a courae, the Inatructor could atteapt to 
liprova perforaance by varloua pedigoglcal dcvlcea. The aubaequent perfonance 
of thaae atudenta wuld give aoie Indication aa to hov succeeaful a given 
device bad been* 
Overall lapact 

The evaluation proceaa haa had a rather aalubrloue lipact on the HJ.Ai 
ptograa. faculty aeibcra are dlscuaalng courae content sore frequentlyi 
Than dlacuaalona are not^auperfldal diacuialona, but appear to be rather 
aubatantiva. Tliece also la a grovlnij'aaount o( dlacuaelon ebout the ' 
operational definition of varloua courae objectivea. On aoaewhat fever 
occaalona, discjaalona are held about the nature of the H.B.A. prograa and 
hov the varloua couraea relate to that nature. Ai lore data becoae available, 
it la expected that these dlacuBslona vlll becoie aore frequent and aore 
^ vldcaptead. It la expected that this criterion referenced evaluation effort 
vlll produce pr<)found, long-run inproveaenta in the content, pedigoglcal 
approachea, and the effcctlveneea of our H.B^Ai prograa. 
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